Ultralytics YOLOv5 Export Competition Winners
Discover the winners of Ultralytics YOLOv5 Export Competition, showcasing the best in AI model deployment across various devices.
With the goal of helping everyone easily train and deploy the best vision AI models, we've organized our first Ultralytics YOLOv5 Export Competition. We value being in touch with members of our open-source community and are always impressed by numerous applications users create.
Link to this sectionDeadline#
The competition ran from May 17th, 2021 to August 31st, 2021 24:00 UTC. After this date, the competition was closed and further submissions were not eligible for prize money.
Link to this sectionEvaluation#
The evaluation took place from September 1, 2021, to September 16, 2021. Our team went thoroughly into each submission.
Link to this section$10000 in Prizes#
The best submission in the categories has claimed the full prize funds of $2000.00 (2000.00 USD) from Ultralytics for that category.
Link to this section5 Categories#
With the help of our amazing community, we previously created 5 categories that represent the most popular real-world deployment scenarios for YOLOv5 models, including Jetson Nano, Raspberry Pi, Google Edge TPU, Desktop CPU and Android Edge devices.
Link to this sectionSubmissions#
Our participants have created a public GitHub repository for their submission, assigned their work an open source license and posted their submission directly to one of the 5 official EXPORT Competition submissions threads to allow the community to vote. Note these threads were only for official submissions. General questions or comments have been asked directly in this thread, or in a new discussion. Links to submissions:
Link to this sectionCompetition Winners#
After much consideration, we decided on the winners for each of the five categories, which represent the most popular real-world deployment scenarios for YOLOv5 models. All participants were contacted personally and the prizes were disbursed to our winners thereafter. Today, we are happy to finally share the best solutions with you!
Link to this sectionNVIDIA Jetson Nano#
Prize: $2000
Link to this sectionGoogle Edge TPU#
Prize: $2000
Link to this sectionAndroid#
Prize: $2000
Link to this sectionRaspberry Pi#
Prize: $2000
No winner *
Link to this sectionIntel/AMD CPU#
Prize: $2000
No winner *
*The submissions in this category did not match the minimum set of requirements in each of the evaluation criteria. Therefore, no winner was selected for the category this time, however, there will be more chances for participants to compete again in the future.
Congratulations to the winners! Be sure to check out their repositories.
"The YOLOv5 library is great - it's updated almost daily, the models work well and the user experience is continually improving. A lot of my research involves deploying ML on embedded devices, and I'd worked with the EdgeTPU previously, so this seemed like a fun challenge." Josh Veitch-Michaelis
We also want to send a big shout-out to everyone who participated in our Export Competition! We are fortunate to have numerous valuable members of our open-source community. It's the contributions from all of you that make our community great.
Stay amazing and keep creating! 🚀
Link to this sectionScoring#
The submissions of the Export competition were judged on the premise of several criteria: simplicity and reproducibility of their export methods, the quality of their documentation, the quality of the export and the speed and accuracy of their exported models. These submissions were then scored both by the team here at Ultralytics and community feedback.
Link to this sectionQuality of Export (20%)#
The simplest export will have the least number of steps, require the least number of arguments/parameters, use the least number of imported packages, and be executable with the smallest amount of code.
Link to this sectionQuality of Documentation (20%)#
Submissions should be well documented using a markdown submission file. Each step should be explained, including setup/requirements, any settings/arguments, export steps, and deployed environment setup, if applicable.
Link to this sectionQuality of Submission (20%)#
Every aspect of export and deployment, starting from an official yolov5s.pt model, should be included. For environments that require special requirements, like Jetson Nano, all packages and/or Docker images must be supplied and documented. For Android deployments, an Android reference app should also be included. A submission must include 100% of what is required to fully export and use a YOLOv5 model.
Link to this sectionSpeed and Accuracy of the Deployed Model (40%)#
Deployed models should return near-identical inference results to official YOLOv5 PyTorch models (i.e. inference with python detect.py --weights yolov5s.pt). Accuracy of deployed solutions will be analyzed on a hold-out test set of Ultralytics images which are unavailable to the public. Speed is very important also, with the fastest deployment solutions heavily favored. For Android, exports to GPU, NNAPI and Hexagon delegates will receive highest scoring here.
