{"id":1936,"date":"2019-07-31T00:42:57","date_gmt":"2019-07-30T22:42:57","guid":{"rendered":"https:\/\/promity.com\/?p=1936"},"modified":"2026-11-02T08:15:57","modified_gmt":"2026-11-02T07:15:57","slug":"bylismy-na-deeplearn2019","status":"publish","type":"post","link":"https:\/\/promity.com\/pl\/2019\/07\/31\/bylismy-na-deeplearn2019\/","title":{"rendered":"Byli\u015bmy na #DeepLearn2019"},"content":{"rendered":"<p><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-1 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-0 fusion_builder_column_1_1 1_1 fusion-one-full fusion-column-first fusion-column-last\" style=\"--awb-bg-size:cover;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-column-wrapper-legacy\"><div class=\"fusion-text fusion-text-1\"><p style=\"text-align: justify;\"><strong>The 3rd International Summer School on Deep Learning<\/strong> is over! The emotions have subsided so we can finally share some impressions with all of you. We spent 5 magnificent days at Global Expo in Warsaw, meeting hundreds of professionals and enthusiasts in AI and Deep Learning, and soaking up the knowledge provided by renowned\u00a0academics and industry pioneers, who shared their views with us.<\/p>\n<p style=\"text-align: justify;\"><strong>DeepLearn2019<\/strong> was a research training event with a global scope aiming at updating participants about the most recent advances in the critical and fast developing areas of deep learning. This is a branch of artificial intelligence covering a spectrum of current exciting machine learning research and industrial innovation that provides more efficient algorithms to deal with large-scale data in neurosciences, computer vision, speech recognition, language processing, human-computer interaction, drug discovery, biomedical informatics, healthcare, recommender systems, learning theory, robotics, games, etc.<\/p>\n<p style=\"text-align: justify;\">Most deep learning subareas has been displayed, and main challenges identified through 3 keynote lectures and 22 four-hour and a half courses, which tackled the most active and promising topics.<\/p>\n<p style=\"text-align: justify;\">Surely the best Keynote was presented by <strong>Mihaela Van Der Schaar<\/strong>\u00a0from the <strong>University of Cambridge<\/strong>, that was quite similar to another talk:<\/p>\n<div class=\"video-shortcode\"><iframe title=\"Transforming medicine through AI-enabled healthcare pathways\" width=\"1260\" height=\"709\" src=\"https:\/\/www.youtube.com\/embed\/TWI-WIoWvfk?start=4466&#038;feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<p style=\"text-align: justify;\">The number of cutting edge papers and magnificence of solutions was astonishing. One of them \u2018<strong><em>Forecasting Individualized Disease Trajectories using Interpretable Deep Learning<\/em><\/strong>\u2019 shows that we need both a probabilistic structure of HMMs and RNNs to model state dynamics to achieve a general and versatile deep probabilistic model capturing<br \/>\ncomplex, non-stationary representations for patient-level trajectories.<\/p>\n<div id=\"attachment_2599\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2599\" class=\"wp-image-2599 size-large\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/001-1024x498.png\" alt=\"\" width=\"1024\" height=\"498\" \/><p id=\"caption-attachment-2599\" class=\"wp-caption-text\"><em>https:\/\/arxiv.org\/pdf\/1810.10489.pdf<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>Bj\u00f6rn Schuller<\/strong> from the <strong>London Imperial College<\/strong>, presented examples of best architectures for audio and multimodal tasks. There were also presented best tools for <a href=\"https:\/\/gitlab.com\/openCoSy\/CAS2T\">Efficient Data Collection<\/a>, <a href=\"https:\/\/www.ihearu-play.eu\/\">Intelligent Data Annotation<\/a> or <a href=\"http:\/\/audeering.com\/technology\/opensmile\/#download\">Feature Extraction<\/a>. Some of the presented audio solutions like &#8222;<a href=\"https:\/\/www.researchgate.net\/profile\/Shahin_Amiriparian\/publication\/318987452_Snore_Sound_Classification_Using_Image-Based_Deep_Spectrum_Features\/links\/599d6f6c0f7e9b892bb3c78b\/Snore-Sound-Classification-Using-Image-Based-Deep-Spectrum-Features.pdf\">Snore sound classification using image-based deep spectrum features<\/a>&#8221; were quite similar to our older approaches &#8211; incidentally, we can read in this work:<\/p>\n<p style=\"text-align: justify;\"><strong><em>&#8222;To date, very little research has been undertaken exploring deep CNN feature representations for audio processing; to the best of our knowledge, they have only been used together with spectrograms for Music Information retrieval [27].&#8221;<\/em><\/strong><\/p>\n<p style=\"text-align: justify;\">By the way &#8211;\u00a0 [27] is &#8222;<a href=\"https:\/\/www.researchgate.net\/publication\/278662921_Deep_Image_Features_in_Music_Information_Retrieval\">Deep Image Features in Music Information Retrieval<\/a>&#8221;\u00a0and this work is done by our Lead Data Scientists \ud83d\ude42<\/p>\n<div id=\"attachment_2600\" style=\"width: 685px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2600\" class=\"wp-image-2600 size-full\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/002.png\" alt=\"\" width=\"675\" height=\"134\" \/><p id=\"caption-attachment-2600\" class=\"wp-caption-text\"><em>&#8222;Snore sound classification using image-based deep spectrum features&#8221;<\/em><\/p><\/div>\n<p style=\"text-align: justify;\">The great course was done by <strong>Aaron Courville<\/strong> from the\u00a0<strong>University of Montr\u00e9al<\/strong> who talked about the main three approaches for Generative Models: Normalizing Flows, Vae, and Gan. Nevertheless, the lecture was really mathematical, Aaron is a great speaker and showed many cool applications like Spade (Semantic Image Synthesis with Spatially-Adaptive Normalization):<\/p>\n<div class=\"video-shortcode\"><iframe title=\"Interactive Demo App &quot;GauGAN&quot;, built using SPADE\" width=\"1260\" height=\"945\" src=\"https:\/\/www.youtube.com\/embed\/MXWm6w4E5q0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<p style=\"text-align: justify;\">By this, he achieved a golden mean between required mathematical foundations and application potential.<\/p>\n<div id=\"attachment_2601\" style=\"width: 1034px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2601\" class=\"size-large wp-image-2601\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/003-1024x628.png\" alt=\"\" width=\"1024\" height=\"628\" \/><p id=\"caption-attachment-2601\" class=\"wp-caption-text\"><em>https:\/\/arxiv.org\/pdf\/1801.03558.pdf<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>Qiang Ji<\/strong> from <strong>Rensselaer Polytechnic Institute\u00a0<\/strong>started with fundamentals of a probabilistic approach going through Bayesian Neural Networks and Probabilistic Models. He pointed out that probabilistic models can capture data, model and output uncertainties that can be used in many applications like outlier detection or active learning. But still probabilistic deep learning suffers from intractable inference problems that lead to scale problems so it is a really good research topic. One of the mentioned probabilistic programming toolboxes in <strong><em>TensorFlow Probability<\/em><\/strong> about which you can read <a href=\"https:\/\/medium.com\/tensorflow\/introducing-tensorflow-probability-dca4c304e245\">here<\/a>.<\/p>\n<div id=\"attachment_2602\" style=\"width: 930px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2602\" class=\"size-full wp-image-2602\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/004.png\" alt=\"\" width=\"920\" height=\"419\" \/><p id=\"caption-attachment-2602\" class=\"wp-caption-text\"><em>https:\/\/metacademy.org\/roadmaps\/rgrosse\/deep_learning\/version\/37<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>Professor Fabio Roli<\/strong> from the <strong>University of Cagliari<\/strong> gave an amazing lecture about Adversarial attacks proofing how important is training ML models with an awareness of them. A bit similar presentation, however much shorter, you can find <a href=\"https:\/\/vimeo.com\/159491487\">here<\/a>. Professor Roli introduced a whole adversarial framework, both describing the most important attacks from a mathematical point of view and giving amazing examples like:<\/p>\n<div class=\"video-shortcode\"><iframe title=\"Tencent Keen Security Lab Experimental Security Research of Tesla Autopilot\" width=\"1260\" height=\"709\" src=\"https:\/\/www.youtube.com\/embed\/6QSsKy0I9LE?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/div>\n<p style=\"text-align: justify;\"><strong>One thing we can be certain &#8211; Machine Learning Security is going to be a hot topic.<\/strong><\/p>\n<div id=\"attachment_2603\" style=\"width: 1034px\" class=\"wp-caption alignnone\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2603\" class=\"size-large wp-image-2603\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/005-1024x401.png\" alt=\"\" width=\"1024\" height=\"401\" \/><p id=\"caption-attachment-2603\" class=\"wp-caption-text\"><em>https:\/\/www.slideshare.net\/pragroup\/wild-patterns-introduction-to-adversarial-machine-learning-itasec-2019\/20<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>Ga\u00ebl Varoquaux<\/strong> from <strong>INRIA<\/strong> pointed out that Data Scientists struggle with problems where there is not a lot of data and presented a bag of tricks on how to deal with them. There was a quite funny example related to \u2018<a href=\"https:\/\/www.nature.com\/articles\/s41746-018-0029-1\">Scalable and accurate deep learning with electronic health records<\/a>\u2019. Despite the uncontested reputation of the authors and a huge amount of data (about 200 000 examples), their Deep Learning solution gains about 2% AUC-ROC relative to baseline one which is a logistic regression \ud83d\ude42<\/p>\n<p style=\"text-align: justify;\">There was a lot of stuff related to a generalization error, matrix factorization or fisher kernels &#8211; everything was served with a high amount of intuition. One really nice example is related to Gamma-Poisson factorization that gives positive and sparse representations of professions that are highly interpretable.<\/p>\n<div id=\"attachment_2604\" style=\"width: 331px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2604\" class=\"size-full wp-image-2604\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/006.png\" alt=\"\" width=\"321\" height=\"347\" \/><p id=\"caption-attachment-2604\" class=\"wp-caption-text\"><em>https:\/\/arxiv.org\/pdf\/1907.01860.pdf<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>James Kwok<\/strong> from\u00a0<strong>Hong Kong University of Science and Technology<\/strong> had one purpose &#8211; to show all techniques related to making Neural Networks smaller and faster! Some common material, however much smaller you can find here.There are many ways of achieving this: network sparsification, quantization, low-rank approximation, distillation &#8211; the number of methods is just overwhelming. However, it does not matter if the purpose is to put a Neural Network on a mobile phone or making Distributed Learning more effective (bandwidth save), <strong>the topic is really hot<\/strong> for both academic and industry.<\/p>\n<div id=\"attachment_2605\" style=\"width: 547px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2605\" class=\"size-full wp-image-2605\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/007.png\" alt=\"\" width=\"537\" height=\"316\" \/><p id=\"caption-attachment-2605\" class=\"wp-caption-text\"><em>https:\/\/arxiv.org\/pdf\/1506.02626.pdf<\/em><\/p><\/div>\n<p style=\"text-align: justify;\"><strong>Ming-Hsuan Yang<\/strong> from the <strong>University of California<\/strong> revealed many Computer Vision anecdotes and presented <strong>Object Tracking<\/strong> problems from fundamentals to current Deep Learning solutions. We started from the evaluation protocols for object tracking and some classical methods like Adaptive Correlation Filters, to review the newest solutions based on Deep Learning in the final. The last shown work \u2018<a href=\"https:\/\/arxiv.org\/pdf\/1806.02323.pdf\">Fast and Accurate Online Video Object Segmentation via Tracking Parts<\/a>\u2019 can be briefed as track then segment then recognize and then reconstruct. Shortly saying, we go beyond bounding boxes and we are on the way toward Cognitive Visual Tracking.<\/p>\n<div id=\"attachment_2606\" style=\"width: 1034px\" class=\"wp-caption alignnone\"><img decoding=\"async\" aria-describedby=\"caption-attachment-2606\" class=\"size-large wp-image-2606\" src=\"https:\/\/promity.pl\/wp-content\/uploads\/2019\/07\/008-1024x427.png\" alt=\"\" width=\"1024\" height=\"427\" \/><p id=\"caption-attachment-2606\" class=\"wp-caption-text\"><em>https:\/\/arxiv.org\/pdf\/1806.02323.pdf<\/em><\/p><\/div>\n<p>See you next year! \ud83d\ude42<\/p>\n<\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-separator\" style=\"margin-left: auto;margin-right: auto;width:100%;max-width:10px;\"><\/div><div class=\"fusion-sep-clear\"><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><div class=\"fusion-fullwidth fullwidth-box fusion-builder-row-2 nonhundred-percent-fullwidth non-hundred-percent-height-scrolling\" style=\"--awb-border-color:#c8ceca;--awb-border-radius-top-left:0px;--awb-border-radius-top-right:0px;--awb-border-radius-bottom-right:0px;--awb-border-radius-bottom-left:0px;--awb-padding-top:10px;--awb-padding-bottom:10px;--awb-margin-top:5px;--awb-margin-bottom:5px;--awb-border-sizes-top:0px;--awb-border-sizes-bottom:0px;--awb-flex-wrap:wrap;\" ><div class=\"fusion-builder-row fusion-row\"><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-1 fusion_builder_column_1_5 1_5 fusion-one-fifth fusion-column-first\" style=\"--awb-bg-size:cover;width:20%;width:calc(20% - ( ( 4% ) * 0.2 ) );margin-right: 4%;\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-column-wrapper-legacy\"><div class=\"fusion-image-element in-legacy-container\" style=\"--awb-caption-title-font-family:var(--h2_typography-font-family);--awb-caption-title-font-weight:var(--h2_typography-font-weight);--awb-caption-title-font-style:var(--h2_typography-font-style);--awb-caption-title-size:var(--h2_typography-font-size);--awb-caption-title-transform:var(--h2_typography-text-transform);--awb-caption-title-line-height:var(--h2_typography-line-height);--awb-caption-title-letter-spacing:var(--h2_typography-letter-spacing);\"><span class=\" fusion-imageframe imageframe-none imageframe-1 hover-type-none\" style=\"border-radius:5px;\"><img decoding=\"async\" width=\"800\" height=\"700\" title=\"gg-01\" src=\"https:\/\/promity.com\/wp-content\/uploads\/2020\/07\/gg-01.jpg\" alt class=\"img-responsive wp-image-1196\" srcset=\"https:\/\/promity.com\/wp-content\/uploads\/2020\/07\/gg-01-200x175.jpg 200w, https:\/\/promity.com\/wp-content\/uploads\/2020\/07\/gg-01-400x350.jpg 400w, https:\/\/promity.com\/wp-content\/uploads\/2020\/07\/gg-01-600x525.jpg 600w, https:\/\/promity.com\/wp-content\/uploads\/2020\/07\/gg-01.jpg 800w\" sizes=\"(max-width: 800px) 100vw, 400px\" \/><\/span><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><div class=\"fusion-layout-column fusion_builder_column fusion-builder-column-2 fusion_builder_column_4_5 4_5 fusion-four-fifth fusion-column-last\" style=\"--awb-padding-top:15px;--awb-padding-right:15px;--awb-padding-bottom:15px;--awb-padding-left:15px;--awb-overflow:hidden;--awb-bg-size:cover;--awb-border-color:#b2b2b2;--awb-border-top:1px;--awb-border-right:1px;--awb-border-bottom:1px;--awb-border-left:1px;--awb-border-style:solid;--awb-border-radius:5px 5px 5px 5px;width:80%;width:calc(80% - ( ( 4% ) * 0.8 ) );\"><div class=\"fusion-column-wrapper fusion-column-has-shadow fusion-flex-column-wrapper-legacy\"><div class=\"fusion-column-content-centered\"><div class=\"fusion-column-content\"><div class=\"fusion-text fusion-text-2\"><p><em><strong>Grzegorz Gwardys<\/strong>\u00a0<\/em> \u2013 W Promity jest liderem zespo\u0142u Data Science \/ Computer Vision, odpowiedzialnego za rozw\u00f3j projekt\u00f3w zwi\u0105zanych ze sztuczn\u0105 inteligencj\u0105 i maszynowym uczeniem. Rozwija r\u00f3wnie\u017c system rozpoznawania twarzy oraz wsp\u00f3\u0142tworzy\u0142 dla Promity rozwi\u0105zania z obszaru Big Data.<\/p>\n<\/div><\/div><\/div><div class=\"fusion-clearfix\"><\/div><\/div><\/div><\/div><\/div><\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":5,"featured_media":1937,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19,21],"tags":[23,25,24],"class_list":["post-1936","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-wydarzenia","tag-ai","tag-design","tag-fashion"],"_links":{"self":[{"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/posts\/1936","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/comments?post=1936"}],"version-history":[{"count":1,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/posts\/1936\/revisions"}],"predecessor-version":[{"id":1941,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/posts\/1936\/revisions\/1941"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/media\/1937"}],"wp:attachment":[{"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/media?parent=1936"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/categories?post=1936"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/promity.com\/pl\/wp-json\/wp\/v2\/tags?post=1936"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}