{"id":777196,"date":"2021-09-22T04:04:58","date_gmt":"2021-09-22T11:04:58","guid":{"rendered":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/?post_type=msr-research-item&#038;p=777196"},"modified":"2021-11-11T18:18:36","modified_gmt":"2021-11-12T02:18:36","slug":"%e5%9f%ba%e4%ba%8e%e4%bc%98%e5%8c%96%e5%8f%8d%e9%a6%88%e7%9a%84%e7%bb%84%e5%90%88%e5%9c%a8%e7%ba%bf%e5%ad%a6%e4%b9%a0combinatorial-online-learning-based-on-optimizing-feedbacks%ef%bc%89","status":"publish","type":"msr-research-item","link":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/publication\/%e5%9f%ba%e4%ba%8e%e4%bc%98%e5%8c%96%e5%8f%8d%e9%a6%88%e7%9a%84%e7%bb%84%e5%90%88%e5%9c%a8%e7%ba%bf%e5%ad%a6%e4%b9%a0combinatorial-online-learning-based-on-optimizing-feedbacks%ef%bc%89\/","title":{"rendered":"\u57fa\u4e8e\u4f18\u5316\u53cd\u9988\u7684\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60 (Combinatorial Online Learning Based on Optimizing feedbacks\uff09"},"content":{"rendered":"<p>\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7814\u7a76\u5982\u4f55\u5728\u4e0e\u73af\u5883\u7684\u4ea4\u4e92\u8fc7\u7a0b\u4e2d\u5b66\u4e60\u672a\u77e5\u53c2\u6570\uff0c\u9010\u6b65\u627e\u5230\u6700\u4f18\u7684\u76ee\u6807\u7ec4\u5408\u3002\u8be5\u95ee\u9898\u6709\u4e30\u5bcc\u7684\u5e94\u7528\u573a\u666f\uff0c\u5982\u5e7f\u544a\u6295\u653e\u3001\u641c\u7d22\u548c\u63a8\u8350\u7b49\u3002\u9996\u5148\u9610\u8ff0\u4e86\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7684\u5b9a\u4e49\u53ca\u5176\u6846\u67b6\u2014\u2014\u7ec4\u5408\u591a\u81c2\u8001\u864e\u673a\u95ee\u9898\uff0c\u5f52\u7eb3\u4e86\u6b64\u6846\u67b6\u4e0b\u7684\u7ecf\u5178\u7b97\u6cd5\u548c\u7814\u7a76\u8fdb\u5c55\uff1b\u7136\u540e\u5177\u4f53\u4ecb\u7ecd\u4e86\u8be5\u95ee\u9898\u7684\u4e24\u4e2a\u5b9e\u9645\u5e94\u7528\u2014\u2014\u5728\u7ebf\u5f71\u54cd\u529b\u6700\u5927\u5316\u548c\u5728\u7ebf\u6392\u5e8f\u5b66\u4e60\u95ee\u9898\uff0c\u4ee5\u53ca\u5176\u7814\u7a76\u8fdb\u5c55\uff1b\u6700\u540e\u5c55\u671b\u4e86\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7684\u672a\u6765\u7814\u7a76\u65b9\u5411\u3002<\/p>\n<p>Combinatorial online learning studies how to learn the unknown parameters and gradually find the optimal combination of targets during the interactions with the environment. This problem has a wide range of applications including advertisement placement, searching and recommendation. Firstly, the definition of combinatorial online learning and its general framework \u2013 the problem of combinatorial multi-armed bandits were introduced, and its traditional algorithms and research progress were summarized. Then, the related works of two specific applications, online influence maximization and online learning to rank, were introduced. Finally, the prospective directions of further researches on combinatorial online learning were discussed.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7814\u7a76\u5982\u4f55\u5728\u4e0e\u73af\u5883\u7684\u4ea4\u4e92\u8fc7\u7a0b\u4e2d\u5b66\u4e60\u672a\u77e5\u53c2\u6570\uff0c\u9010\u6b65\u627e\u5230\u6700\u4f18\u7684\u76ee\u6807\u7ec4\u5408\u3002\u8be5\u95ee\u9898\u6709\u4e30\u5bcc\u7684\u5e94\u7528\u573a\u666f\uff0c\u5982\u5e7f\u544a\u6295\u653e\u3001\u641c\u7d22\u548c\u63a8\u8350\u7b49\u3002\u9996\u5148\u9610\u8ff0\u4e86\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7684\u5b9a\u4e49\u53ca\u5176\u6846\u67b6\u2014\u2014\u7ec4\u5408\u591a\u81c2\u8001\u864e\u673a\u95ee\u9898\uff0c\u5f52\u7eb3\u4e86\u6b64\u6846\u67b6\u4e0b\u7684\u7ecf\u5178\u7b97\u6cd5\u548c\u7814\u7a76\u8fdb\u5c55\uff1b\u7136\u540e\u5177\u4f53\u4ecb\u7ecd\u4e86\u8be5\u95ee\u9898\u7684\u4e24\u4e2a\u5b9e\u9645\u5e94\u7528\u2014\u2014\u5728\u7ebf\u5f71\u54cd\u529b\u6700\u5927\u5316\u548c\u5728\u7ebf\u6392\u5e8f\u5b66\u4e60\u95ee\u9898\uff0c\u4ee5\u53ca\u5176\u7814\u7a76\u8fdb\u5c55\uff1b\u6700\u540e\u5c55\u671b\u4e86\u7ec4\u5408\u5728\u7ebf\u5b66\u4e60\u95ee\u9898\u7684\u672a\u6765\u7814\u7a76\u65b9\u5411\u3002 Combinatorial online learning studies how to learn the unknown parameters and gradually find the optimal combination of targets during the interactions with the environment. This problem has a wide range of applications including advertisement placement, searching and recommendation. Firstly, the definition of combinatorial online learning and its general framework \u2013 the problem of combinatorial [&hellip;]<\/p>\n","protected":false},"featured_media":0,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":null,"msr_publishername":"","msr_publisher_other":"","msr_booktitle":"","msr_chapter":"","msr_edition":"","msr_editors":"","msr_how_published":"","msr_isbn":"","msr_issue":"5","msr_journal":"\u5927\u6570\u636e\uff08Big Data Research\uff09","msr_number":"","msr_organization":"","msr_pages_string":"","msr_page_range_start":"","msr_page_range_end":"","msr_series":"","msr_volume":"7","msr_copyright":"","msr_conference_name":"","msr_doi":"","msr_arxiv_id":"","msr_s2_paper_id":"","msr_mag_id":"","msr_pubmed_id":"","msr_other_authors":"","msr_other_contributors":"","msr_speaker":"","msr_award":"","msr_affiliation":"","msr_institution":"","msr_host":"","msr_version":"","msr_duration":"","msr_original_fields_of_study":"","msr_release_tracker_id":"","msr_s2_match_type":"","msr_citation_count_updated":"","msr_published_date":"2021-9-1","msr_highlight_text":"","msr_notes":"","msr_longbiography":"","msr_publicationurl":"","msr_external_url":"","msr_secondary_video_url":"","msr_conference_url":"","msr_journal_url":"","msr_s2_pdf_url":"","msr_year":0,"msr_citation_count":0,"msr_influential_citations":0,"msr_reference_count":0,"msr_s2_match_confidence":0,"msr_microsoftintellectualproperty":true,"msr_s2_open_access":false,"msr_s2_author_ids":[],"msr_pub_ids":[],"msr_hide_image_in_river":0,"footnotes":""},"msr-research-highlight":[],"research-area":[13561,13556],"msr-publication-type":[193715],"msr-publisher":[],"msr-focus-area":[],"msr-locale":[268875],"msr-post-option":[],"msr-field-of-study":[],"msr-conference":[],"msr-journal":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-777196","msr-research-item","type-msr-research-item","status-publish","hentry","msr-research-area-algorithms","msr-research-area-artificial-intelligence","msr-locale-en_us"],"msr_publishername":"","msr_edition":"","msr_affiliation":"","msr_published_date":"2021-9-1","msr_host":"","msr_duration":"","msr_version":"","msr_speaker":"","msr_other_contributors":"","msr_booktitle":"","msr_pages_string":"","msr_chapter":"","msr_isbn":"","msr_journal":"\u5927\u6570\u636e\uff08Big Data Research\uff09","msr_volume":"7","msr_number":"","msr_editors":"","msr_series":"","msr_issue":"5","msr_organization":"","msr_how_published":"","msr_notes":"","msr_highlight_text":"","msr_release_tracker_id":"","msr_original_fields_of_study":"","msr_download_urls":"","msr_external_url":"","msr_secondary_video_url":"","msr_longbiography":"","msr_microsoftintellectualproperty":1,"msr_main_download":"","msr_publicationurl":"","msr_doi":"","msr_publication_uploader":[{"type":"file","viewUrl":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2021\/09\/BDR21_09_CMAB.pdf","id":"777199","title":"bdr21_09_cmab","label_id":"243132","label":0}],"msr_related_uploader":"","msr_citation_count":0,"msr_citation_count_updated":"","msr_s2_paper_id":"","msr_influential_citations":0,"msr_reference_count":0,"msr_arxiv_id":"","msr_s2_author_ids":[],"msr_s2_open_access":false,"msr_s2_pdf_url":null,"msr_attachments":[{"id":777199,"url":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-content\/uploads\/2021\/09\/BDR21_09_CMAB.pdf"}],"msr-author-ordering":[{"type":"text","value":"Fang Kong","user_id":0,"rest_url":false},{"type":"text","value":"Yueran Yang","user_id":0,"rest_url":false},{"type":"user_nicename","value":"Wei Chen","user_id":34795,"rest_url":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Wei Chen"},{"type":"text","value":"Shuai Li","user_id":0,"rest_url":false}],"msr_impact_theme":[],"msr_research_lab":[199560],"msr_event":[],"msr_group":[802999],"msr_project":[],"publication":[],"video":[],"msr-tool":[],"msr_publication_type":"article","related_content":[],"_links":{"self":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/777196","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item"}],"about":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-research-item"}],"version-history":[{"count":2,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/777196\/revisions"}],"predecessor-version":[{"id":795092,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/777196\/revisions\/795092"}],"wp:attachment":[{"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/media?parent=777196"}],"wp:term":[{"taxonomy":"msr-research-highlight","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-research-highlight?post=777196"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=777196"},{"taxonomy":"msr-publication-type","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-type?post=777196"},{"taxonomy":"msr-publisher","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-publisher?post=777196"},{"taxonomy":"msr-focus-area","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-focus-area?post=777196"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=777196"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=777196"},{"taxonomy":"msr-field-of-study","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-field-of-study?post=777196"},{"taxonomy":"msr-conference","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-conference?post=777196"},{"taxonomy":"msr-journal","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-journal?post=777196"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=777196"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/cm-edgetun.pages.dev\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=777196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}