{ "127692-21859491": { "datetime_modified":"20250120T151857", "datetime_start":"20250320T153000", "datetime_end":"20250320T163000", "has_end_time":1, "date_start":"2025-03-20", "date_end":"2025-03-20", "time_start":"15:30:00", "time_end":"16:30:00", "time_zone":"America\/Detroit", "event_title":"MICDE-EECS Seminar - Mikhail Belkin, Professor, University of California San Diego", "occurrence_title":"", "combined_title":"MICDE-EECS Seminar - Mikhail Belkin, Professor, University of California San Diego: Emergence and grokking in \u201csimple\u201d architectures", "event_subtitle":"Emergence and grokking in \u201csimple\u201d architectures", "event_type":"Workshop \/ Seminar", "event_type_id":"21", "description":"Bio: Mikhail Belkin is a Professor at Halicioglu Data Science Institute and Computer Science and Engineering Department at UCSD and an Amazon Scholar. Prior to that he was a Professor at the Department of Computer Science and Engineering and the Department of Statistics at the Ohio State University. He received his Ph.D. from the Department of Mathematics at the University of Chicago (advised by Partha Niyogi). His research interests are broadly in theory and applications of machine learning, deep learning and data analysis. Some of his well-known work includes widely used Laplacian Eigenmaps, Graph Regularization and Manifold Regularization algorithms, which brought ideas from classical differential geometry and spectral graph theory to data science. His more recent work has been concerned with understanding remarkable mathematical and statistical phenomena observed in deep learning. The empirical evidence necessitated revisiting some of the classical concepts in statistics and optimization, including the basic notion of over-fitting. One of his key findings has been the \"double descent\" risk curve that extends the textbook U-shaped bias-variance trade-off curve beyond the point of interpolation. His recent work focusses on understanding feature learning and over-parameterization in deep learning. Mikhail Belkin is an ACM Fellow and a recipient of a NSF Career Award and a number of best paper and other awards. He had served on the editorial boards of IEEE Proceedings on Pattern Analysis Machine Intelligence and the Journal of the Machine Learning Research. He is the editor-in-chief of SIAM Journal on Mathematics of Data Science (SIMODS).\r\n\r\nAbstract: In recent years, transformers have become a dominant machine learning methodology.\r\nA key element of transformer architectures is a standard neural network (MLP). I argue that MLPs alone already exhibit many remarkable behaviors observed in modern LLMs, including emergent phenomena. Furthermore, despite large amounts of work, we are still far from understanding how 2-layer MLPs learn relatively simple problems, such as \u201cgrokking\u201d modular arithmetic. I will discuss recent progress and argue that feature-learning kernel machines (Recursive Feature Machines) isolate some key computational aspects of modern neural architectures and are preferable to MLPs as a model for analysis of emergent phenomena.", "occurrence_notes":null, "guid":"127692-21859491@events.umich.edu", "permalink":"http:\/\/events.umich.edu\/event\/127692", "building_id":"1000448", "building_name":"Electrical Engineering and Computer Science Building", "campus_maps_id":"56", "room":"1311", "location_name":"Electrical Engineering and Computer Science Building", "has_livestream":0, "cost":"", "tags":["Electrical And Computer Engineering","Electrical Engineering and Computer Science","Micde","Micde Seminar","Michigan Engineering","North campus"], "website":"http:\/\/misha.belkin-wang.org\/", "sponsors":[ { "group_name":"Michigan Institute for Computational Discovery and Engineering", "group_id":"3286", "website":"http:\/\/micde.umich.edu" }, { "group_name":"Electrical Engineering and Computer Science", "group_id":"3989", "website":"" } ], "image_url":"https:\/\/events.umich.edu\/media\/attachments\/2025\/01\/event_127692_original-1.png", "styled_images":{ "event_thumb":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_thumb\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_large":"https:\/\/events.umich.edu\/media\/cache\/event_large\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_large_2x":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_large_2x\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_large_lightbox":"https:\/\/events.umich.edu\/media\/cache\/event_large_lightbox\/media\/attachments\/2025\/01\/event_127692_original-1.png", "group_thumb":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_thumb\/media\/attachments\/2025\/01\/event_127692_original-1.png", "group_thumb_square":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_thumb_square\/media\/attachments\/2025\/01\/event_127692_original-1.png", "group_large":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_large\/media\/attachments\/2025\/01\/event_127692_original-1.png", "group_large_lightbox":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_large_lightbox\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_large_crop":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_large_crop\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_list":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_list\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_list_2x":"https:\/\/events.umich.edu\/media\/cache\/event_list_2x\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_grid":"https:\/\/events.umich.edu\/media\/cache\/event_grid\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_grid_2x":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_grid_2x\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_feature_large":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_feature_large\/media\/attachments\/2025\/01\/event_127692_original-1.png", "event_feature_thumb":"https:\/\/events.umich.edu\/media\/cache\/event_feature_thumb\/media\/attachments\/2025\/01\/event_127692_original-1.png" }, "occurrence_count":1, "first_occurrence":21859491 } , "133711-21873465": { "datetime_modified":"20250311T151530", "datetime_start":"20250320T153000", "datetime_end":"20250320T162000", "has_end_time":1, "date_start":"2025-03-20", "date_end":"2025-03-20", "time_start":"15:30:00", "time_end":"16:20:00", "time_zone":"America\/Detroit", "event_title":"The Department of Astronomy 2024-2025 Colloquium Series Presents:", "occurrence_title":"", "combined_title":"The Department of Astronomy 2024-2025 Colloquium Series Presents:: Dr. Joe Hennawi, Associate Professor, UCSB", "event_subtitle":"Dr. Joe Hennawi, Associate Professor, UCSB", "event_type":"Lecture \/ Discussion", "event_type_id":"13", "description":"\"How Long do Quasars Shine?\"\r\n\r\nLuminous quasars are believed to be the progenitors of the supermassive black holes observed ubiquitously at the centers of all massive galaxies, but we are still in the dark about how these black holes formed. Our ignorance largely results from the fact that the expected timescale for supermassive black hole growth of 50 million years is far longer than the mere fifty years that humans have been observing quasars. A holy grail would thus be a direct measurement of quasar lifetimes, shedding light on the physical mechanisms responsible for fueling black hole growth, and how the back-reaction of this growth might influence how galaxies form. I will discuss two very different experiments that allow us to construct cosmic clocks that can accurately time the duration of luminous quasar activity on timescales of kiloyears to gigayears. One exploits the clustering pattern of quasars on the sky, which has recently been measured by JWST. The other uses observations of diffuse intergalactic gas in quasar environs. I will also touch upon how the latter can be used to constrain the reionization history of the Universe.", "occurrence_notes":null, "guid":"133711-21873465@events.umich.edu", "permalink":"http:\/\/events.umich.edu\/event\/133711", "building_id":"1000167", "building_name":"West Hall", "campus_maps_id":"163", "room":"411", "location_name":"West Hall", "has_livestream":0, "cost":"", "tags":["astronomy","astrophysics"], "website":"https:\/\/lsa.umich.edu\/astro", "sponsors":[ { "group_name":"Department of Astronomy", "group_id":"1178", "website":"" }, { "group_name":"Department of Physics", "group_id":"1965", "website":"" } ], "image_url":"https:\/\/events.umich.edu\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "styled_images":{ "event_thumb":"https:\/\/events.umich.edu\/media\/cache\/event_thumb\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_large":"https:\/\/events.umich.edu\/media\/cache\/event_large\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_large_2x":"https:\/\/events.umich.edu\/media\/cache\/event_large_2x\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_large_lightbox":"https:\/\/events.umich.edu\/media\/cache\/event_large_lightbox\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "group_thumb":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_thumb\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "group_thumb_square":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_thumb_square\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "group_large":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_large\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "group_large_lightbox":"https:\/\/events.umich.edu\/media\/cache\/resolve\/group_large_lightbox\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_large_crop":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_large_crop\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_list":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_list\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_list_2x":"https:\/\/events.umich.edu\/media\/cache\/event_list_2x\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_grid":"https:\/\/events.umich.edu\/media\/cache\/event_grid\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_grid_2x":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_grid_2x\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_feature_large":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_feature_large\/media\/attachments\/2025\/03\/event_133711_original-1.jpg", "event_feature_thumb":"https:\/\/events.umich.edu\/media\/cache\/resolve\/event_feature_thumb\/media\/attachments\/2025\/03\/event_133711_original-1.jpg" }, "occurrence_count":1, "first_occurrence":21873465 } }