{"id":264486,"date":"2016-07-25T07:46:11","date_gmt":"2016-07-25T14:46:11","guid":{"rendered":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/?p=264486"},"modified":"2016-08-17T15:11:38","modified_gmt":"2016-08-17T22:11:38","slug":"researchers-team-up-with-chinese-botanists-on-machine-learning-flower-recognition-project","status":"publish","type":"post","link":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/blog\/researchers-team-up-with-chinese-botanists-on-machine-learning-flower-recognition-project\/","title":{"rendered":"Researchers team up with Chinese botanists on machine learning, flower-recognition project"},"content":{"rendered":"<p><em>By <a href=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/people\/guobinwu\/\" target=\"_blank\">Guobin Wu<\/a>, Senior Research Program Manager, Microsoft Research Asia<\/em><\/p>\n<p>Has this ever happened to you? You\u2019re out walking with your daughter. She finds a beautiful flower, quizzes you on it, but you\u2019re stumped \u2014 you have no idea what it is. Instead of having to admit you don\u2019t know, what if you could quickly identify the flower or any other plant wherever you happen to be? But how? At least 250,000 species of flowers exist and even experienced botanists have trouble identifying them all.\u00a0Now there\u2019s a way thanks to the rising power and sophistication of image recognition and the ease of taking pictures with your smartphone.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-264567 \" src=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project1-2-1024x619.png\" alt=\"Smart Flower Recognition System\" width=\"900\" height=\"544\" srcset=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project1-2-1024x619.png 1024w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project1-2-300x181.png 300w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project1-2-768x464.png 768w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project1-2.png 1245w\" sizes=\"auto, (max-width: 900px) 100vw, 900px\" \/><\/p>\n<p>It\u2019s called the Smart Flower Recognition System but it might never have happened were it not for a chance encounter last year between Microsoft researchers and botanists at the Institute of Botany, Chinese Academy of Sciences (IBCAS).\u00a0<a href=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/people\/yongrui\/\" target=\"_blank\">Yong Rui<\/a>, assistant managing director of Microsoft Research Asia (MSRA), was explaining image-recognition technology at a seminar \u2014 much to the delight of IBCAS botanists whose own arduous efforts to collect data on regional flower distribution were experiencing poor results. The IBCAS botanists soon realized the potential of MSRA\u2019s image-recognition technology. At the same time, Yong Rui knew he had found the perfect vehicle to improve image recognition while addressing a reality-based problem that benefits society.\u00a0It also helped that IBCAS had accumulated a massive public store of 2.6 million images. Since anyone in the world could upload pictures to this flower photo dataset \u2014 and no human could possibly supervise the uploads \u2014 the MSRA team had to create algorithms to filter out the \u201cbad\u201d pictures. That was the first of many difficult problems facing researcher Jianlong Fu and his team in building a tool capable of discerning tiny anomalies among the many species of flowers.<\/p>\n<p>To do so they trained a deep neural network to recognize images using a set of learnable filters. In a nutshell, it works like this:<\/p>\n<blockquote><p>During the forward pass, each filter is convolved across the width and height of the input volume, computing the dot product between the entries of the filter and the input. This produces a 2-dimensional activation map of that filter. As a result, the network learns filters that activate per specific types of features at a given spatial position in the input.<\/p><\/blockquote>\n<p>Inputting millions of pictures into the deep-learning framework, MSRA researchers eventually enabled the engine to accurately identify images more than 90 percent of the time, an astonishing rate just shy of human capabilities.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-264540\" src=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project2.png\" alt=\"Caffe deep-learning framework\" width=\"556\" height=\"312\" srcset=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project2.png 556w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project2-300x168.png 300w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project2-343x193.png 343w\" sizes=\"auto, (max-width: 556px) 100vw, 556px\" \/><\/p>\n<p>And the project greatly helped the Chinese botanists in meeting their goals.\u00a0\u201cThe flower-recognition engine enables domain experts to acquire plant distribution in China in an efficient way,\u201d said Zheping Xu, assistant director of IBCAS. \u201cNot only that, this engine can help ordinary people who have a strong interest in flowers to gain more knowledge.\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-264543\" src=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project3.png.jpg\" alt=\"flower project3.png\" width=\"671\" height=\"107\" srcset=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project3.png.jpg 671w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project3.png-300x48.jpg 300w, https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2016\/07\/flower-project3.png-665x107.jpg 665w\" sizes=\"auto, (max-width: 671px) 100vw, 671px\" \/><\/p>\n<p>In the future, MSRA and IBCAS will continue the collaboration, hoping to create applications based on the flower-recognition engine, so that botanists can conduct their research, parents can appear infallible to their kids, and everyone can appreciate flowers on an even deeper level.<\/p>\n<p><strong>Learn more<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/lab\/microsoft-research-asia\/\">Microsoft Research Asia<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>By Guobin Wu, Senior Research Program Manager, Microsoft Research Asia Has this ever happened to you? You\u2019re out walking with your daughter. She finds a beautiful flower, quizzes you on it, but you\u2019re stumped \u2014 you have no idea what it is. Instead of having to admit you don\u2019t know, what if you could quickly [&hellip;]<\/p>\n","protected":false},"author":39507,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[],"msr_hide_image_in_river":0,"footnotes":""},"categories":[194478,194480,194455],"tags":[208731,194988,208725,208719,208728,208722],"research-area":[13556,198583,13551],"msr-region":[],"msr-event-type":[],"msr-locale":[268875],"msr-post-option":[],"msr-impact-theme":[],"msr-promo-type":[],"msr-podcast-series":[],"class_list":["post-264486","post","type-post","status-publish","format-standard","hentry","category-ecology-and-environment","category-graphics-and-multimedia","category-machine-learning","tag-caffe-deep-learning-framework","tag-chinese-academy-of-sciences","tag-flower-identification","tag-image-recognition","tag-institute-of-botany","tag-smart-flower-recognition-system","msr-research-area-artificial-intelligence","msr-research-area-ecology-environment","msr-research-area-graphics-and-multimedia","msr-locale-en_us"],"msr_event_details":{"start":"","end":"","location":""},"podcast_url":"","podcast_episode":"","msr_research_lab":[199560],"msr_impact_theme":[],"related-publications":[],"related-downloads":[],"related-videos":[],"related-academic-programs":[],"related-groups":[],"related-projects":[],"related-events":[],"related-researchers":[],"msr_type":"Post","byline":"","formattedDate":"July 25, 2016","formattedExcerpt":"By Guobin Wu, Senior Research Program Manager, Microsoft Research Asia Has this ever happened to you? You\u2019re out walking with your daughter. She finds a beautiful flower, quizzes you on it, but you\u2019re stumped \u2014 you have no idea what it is. Instead of having&hellip;","locale":{"slug":"en_us","name":"English","native":"","english":"English"},"_links":{"self":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/264486","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/users\/39507"}],"replies":[{"embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/comments?post=264486"}],"version-history":[{"count":11,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/264486\/revisions"}],"predecessor-version":[{"id":278379,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/posts\/264486\/revisions\/278379"}],"wp:attachment":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media?parent=264486"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/categories?post=264486"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/tags?post=264486"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=264486"},{"taxonomy":"msr-region","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-region?post=264486"},{"taxonomy":"msr-event-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-event-type?post=264486"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=264486"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=264486"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=264486"},{"taxonomy":"msr-promo-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-promo-type?post=264486"},{"taxonomy":"msr-podcast-series","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-podcast-series?post=264486"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}