Snake Species Identification Challenge

URL: https://www.aicrowd.com/challenges/snake-species-identification-challenge

Snakebite is the most deadly neglected tropical disease (NTD), being responsible for a dramatic humanitarian crisis in global health

Snakebite causes over 100,000 human deaths and 400,000 victims of disability and disfigurement globally every year. It affects poor and rural communities in developing countries, which host the highest venomous snake diversity and the highest burden of snakebite due to limited medical expertise and access to antivenoms

Antivenoms can be life‐saving when correctly administered but this depends first on the correct taxonomic identification (i.e. family, genus, species) of the biting snake. Snake identification is challenging due to:

  • their high diversity
  • the incomplete or misleading information provided by snakebite victims
  • the lack of knowledge or resources in herpetology that healthcare professionals have

In this challenge we want to explore how Machine Learning can help with snake identification, in order to potentially reduce erroneous and delayed healthcare actions.

IDAO: International Data Analysis Olympiad

URL: https://idao.world/

Higher School of Economics and Yandex are proud to announce the 3rd international data analysts olympiad.

The event is open to all teams and individuals, be they undergraduate, postgraduate or PhD students, company employees, researchers or new data scientists, .

The event aims to bridge the gap between the all-increasing complexity of Machine Learning models and performance bottlenecks of the industry. The participants will strive not only to maximize the quality of their predictions, but also to devise resource-efficient algorithms.

This will be a team machine learning competition, divided into two stages. The first stage will be online, open to all participants. The second stage will be the offline on-site finals, in which the top 30 performing teams from the online round will compete at the Yandex office in Moscow.

DrivenData: Hakuna Ma-data: Identify Wildlife on the Serengeti with AI for Earth

Link: https://www.drivendata.org/competitions/59/camera-trap-serengeti/

Overview

Leverage millions of images of animals on the Serengeti to build a classifier that distinguishes between gazelles, lions, and more!

In this competition, participants will predict the presence and species of wildlife in new camera trap data from the Snapshot Serengeti project, which boasts over 6 million images.

Camera traps are motion-triggered systems for passively collecting animal behavior data with minimal disturbance to their natural tendencies. Camera traps are an invaluable tool in conservation research, but the sheer amount of data they generate presents a huge barrier to using them effectively. This is where AI can help!

There are two immediate challenges where efforts like this competition are needed:

  • Camera traps can’t automatically label the animals they observe, creating an immense (and sometimes prohibitive) burden on humans to determine where and what wildlife are present.
  • Even when automated animal tagging models are available, the models that do exist don’t generalize well across time and locations, severely limiting their usefulness with new data.

To address these opportunities, we’re challenging data scientists, researchers, and developers from around the world to build the best algorithms for wildlife detection.

The competition is designed with a few objectives in mind:

  • Innovation: Participants use state-of-the-art approaches in computer vision and AI and get live feedback on how well their solutions perform
  • Generalization: This competition is designed to reward the best generalizable solutions. The private test data used to determine the winners will come entirely from the latest, unreleased season of data from the Snapshot Serengeti project (season 11). For more information on the competition timeline and evaluation, see the problem description.
  • Execution: Models are trained locally and submitted to execute inference in the cloud – read on!
  • Openness: All prize-winning models are released under an open source license for anyone to use and learn from

This is a brand new kind of DrivenData challenge! Previous models trained for camera trap images have often failed to generalize well. In this competition, we want to reward the models that generalize best to new images, so you won’t interact directly with the test set.  Rather than submitting your predicted labels for a test set you have, you’ll package up everything needed to do inference and send it to us. We’ll execute that code on Azure in a Docker container that has access to the test set images. By leveraging Microsoft Azure’s cloud computing platform and Docker containers, we’re moving our competition infrastructure one step closer to translating participants’ innovation into impact.

We can’t wait to run what you come up with!

National Data Science Challenge

National Data Science Challenge: https://careers.shopee.co.id/ndsc/

The objectives of the National Data Science Challenge (NDSC) are to:

  • Bring the tech community closer through working together and knowledge sharing
  • Provide an environment for the development of creative new ideas in Data Science
  • Equip students and professionals with essential technical skills and expertise to prepare them for Industry 4.0

Through this competition, we hope to showcase the ubiquity and usefulness of data in getting insights, thus reinforcing Indonesia’s emphasis on driving the digital economy and the use of big data.

Collaborative Challenge: Detecting Drought from Space

Deep Learning for Climate Adaptation: Detecting Drought from Space

The challenge

The dataset contains about 100,000 satellite images of Northern Kenya in 10 frequency bands, collected by the International Livestock Research Institute. Local experts (pastoralists, or nomadic herders) manually labeled the forage quality at the corresponding geolocations—specifically, the number of cows from {0, 1, 2, 3+} that the location at the center of the satellite image can feed. Each satellite image is 1.95km across, and each pixel in it represents a 30 meter square. Pastoralists estimate the forage quality within 20 meters when they stand on location, an area slightly larger than a pixel in the full 65×65-pixel satellite image. The satellite images thus provide a lot of extra context, which may prove useful since forage quality is correlated across space. The challenge is to learn a mapping from a satellite image to forage quality so we can more accurately predict drought conditions. Furthermore, the current labeling is very sparse, and we want dense predictions of forage quality at any pixel in a satellite image, not just at the center.

Buku Gratis Data Mining

Berikut ini beberapa buku data mining yang nampaknya bagus (dari situs http://christonard.com/12-free-data-mining-books/):

  1. An Introduction to Statistical Learning with Applications in R by James, Witten, Hastie & Tibshirani – . 426 Pages.
  2. The Elements of Statistical Learning by Hastie, Tibshirani & Friedman – 745 Pages.
  3. A Programmer’s Guide to Data Mining by Ron Zacharski –
  4. Probabilistic Programming & Bayesian Methods for Hackers by Cam Davidson-Pilson –
  5. Think Bayes, Bayesian Statistics Made Simple by Allen B. Downey –. 195 Pages.
  6. Data Mining and Analysis, Fundamental Concepts and Algorithms by Zaki & Meira –  599 Pages.
  7. An Introduction to Data Science by Jeffrey Stanton –  195 Pages.
  8. Machine Learning by Chebira, Mellouk & others –  422 Pages.
  9. Machine Learning – The Complete Guide
  10. Bayesian Reasoning and Machine Learning by David Barber – 648 Pages.
  11. A Course in Machine Learning by Hal Daumé III – . 189 Pages.
  12. Information Theory, Inference and Learning Algorithms by David J.C. MacKay – 628 Pages.
  13. Modeling with Data by Ben Klemens –  454 Pages.
  14. Mining of Massive Datasets by Rajaraman & Ullman . 493 Pages

Redmine Installation Problems in Ubuntu 18.04.03

Problems encountered while installing Redmine 3.4.4 in Ubuntu 18.04.03

PROBLEM #1 Cannot Build SQLite3

# gem update
Updating installed gems
Updating sqlite3
Building native extensions. This could take a while...
ERROR: Error installing sqlite3:
ERROR: Failed to build gem native extension.

current directory: /var/lib/gems/2.5.0/gems/sqlite3-1.4.1/ext/sqlite3
/usr/bin/ruby2.5 -r ./siteconf20190813-10918-113tafq.rb extconf.rb
checking for sqlite3.h... no
sqlite3.h is missing. Try 'brew install sqlite3',
'yum install sqlite-devel' or 'apt-get install libsqlite3-dev'
and check your shared library search path (the
location where your sqlite3 shared library is located).
*** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of necessary
libraries and/or headers. Check the mkmf.log file for more details. You may
need configuration options.

Provided configuration options:
--with-opt-dir
--without-opt-dir
--with-opt-include
--without-opt-include=${opt-dir}/include
--with-opt-lib
--without-opt-lib=${opt-dir}/lib
--with-make-prog
--without-make-prog
--srcdir=.
--curdir
--ruby=/usr/bin/$(RUBY_BASE_NAME)2.5
--with-sqlcipher
--without-sqlcipher
--with-sqlite3-config
--without-sqlite3-config
--with-pkg-config
--without-pkg-config
--with-sqlcipher
--without-sqlcipher
--with-sqlite3-dir
--without-sqlite3-dir
--with-sqlite3-include
--without-sqlite3-include=${sqlite3-dir}/include
--with-sqlite3-lib
--without-sqlite3-lib=${sqlite3-dir}/lib

To see why this extension failed to compile, please check the mkmf.log which can be found here:

/var/lib/gems/2.5.0/extensions/x86_64-linux/2.5.0/sqlite3-1.4.1/mkmf.log

extconf failed, exit code 1

Gem files will remain installed in /var/lib/gems/2.5.0/gems/sqlite3-1.4.1 for inspection.
Results logged to /var/lib/gems/2.5.0/extensions/x86_64-linux/2.5.0/sqlite3-1.4.1/gem_make.out
Updating web-console
ERROR: Error installing web-console:
Unresolved dependency found during sorting - activesupport (>= 4.2.0) (requested by rails-dom-testing-2.0.3)
Gems updated: sqlite3

SOLUTION: as suggested in the error message, just install libsqlite3-dev:

apt-get install libsqlite3-dev

PROBLEM #2: cannot update webconsole

# gem update
Updating installed gems
Updating web-console
ERROR: Error installing web-console:
Unresolved dependency found during sorting - activesupport (>= 4.2.0) (requested by rails-dom-testing-2.0.3)
Nothing to update

SOLUTION:
as in https://stackoverflow.com/questions/56084457/getting-error-when-installing-web-console

‘gem install -f web-console’

PROBLEM #3: Cannot bundle install

bundle install is needed to upgrade all gems to latest versions.

Problem:
> bundle install --without development test
Traceback (most recent call last):
1: from /usr/local/bin/bundle:23:in `<main>'
/usr/local/bin/bundle:23:in `load': cannot load such file -- /usr/share/rubygems-integration/all/gems/bundler-1.16.1/exe/bundle (LoadError)

Solution:

SOLUTION #1:

Ref: https://github.com/bundler/bundler/issues/6227
Just run:

gem update --system
gem uninstall bundler
gem install bundler
bundle install

this solution doesn’t not always work

SOLUTION #2: Use old bundler

https://www.redmine.org/issues/30353

gem install bundler -v 1.17.3 # Currently the latest bundler version < 2.0
bundle _1.17.3_ install