1549397206672.jpeg

Resurrecting Recurrent Neural Networks for Language Modelling

-
Add to Calendar Resurrecting Recurrent Neural Networks for Language ModellingThe Buttery
Location
The Buttery
Speakers
Dr. Razvan Pascanu (Google DeepMind)
Booking Required
Not Required
Accessibility
There is provision for wheelchair users.
Bio:

I'm currently a Research Scientist at DeepMind. I grew up in Romania and studied computer science and electrical engineering for my undergrads in Germany. I got my MSc from Jacobs University, Bremen in 2009. I hold a PhD from University of Montreal (2014), which I did under the supervision of prof. Yoshua Bengio. I was involved in developing Theano and helped writing some of the deep learning tutorials for Theano. I've published several papers on topics surrounding deep learning and deep reinforcement learning (see my scholar page). I'm one of the organizers of EEML (www.eeml.eu) and part of the organizers of AIRomania. As part of the AIRomania community, I have organized RomanianAIDays since 2020, and helped build a course on AI aimed at high school students.



Abstract:

In this talk I will focus on State Space Models (SSMs) , a subclass of Recurrent Neural Networks (RNNs) that has recently gained some attention through works like Mamba, obtaining strong performance against transformer baselines. I will start by first explaining how SSMs can be viewed as just a particular parametrization of RNNs and what are the crucial differences compared to previous recurrent architectures that led to these results. My goal is to demystify the relative complex parametrization of the architecture and identify what elements are needed for the model to perform well. In this process I will introduce the Linear Recurrent Unit (LRU), a simplified linear layer inspired by existing SSM layers. In the second part of the talk, I will focus on language modelling and the block structure in which such layers tend to be embedded. I will argue that beyond the recurrent layer itself, the block structure borrowed from transformers plays a crucial role in the recent successes of this architecture, and present results at scale of well performing hybrid recurrent architectures as compared to strong transformer baseline. I will close the talk with a few open questions and thoughts on the importance of recurrence in modern deep learning models.
wolfson pic.jpeg

Wolfson Family Society International Party

-
Add to Calendar Wolfson Family Society International PartyThe Buttery
Location
The Buttery
Speakers
N/A
Event price
N/A
Booking Required
Recommended
The Wolfson Family Society invites all families to our International Party on 2nd March 2024 from 4-6pm at the Buttery. Please bring along a dish from your home country to share (home made or store bought). Please include a note of ingredients in case of allergens. Drinks will be provided. Sign up to help us plan.



See you!



Emilia & Harriet
Movie-Night-Clipart-Free-Graphics-33084077-2-580x387.png

Wolfson Family Society Movie Night

-
Add to Calendar Wolfson Family Society Movie NightThe Buttery
Location
The Buttery
Speakers
N/A
Event price
Free
Booking Required
Recommended
Join us for our first event of the year, a movie night on 10th February, 2024 @ the Buttery from 6 - 8pm. Light snacks and drinks will be provided. Sign up to help us plan. Thank you!



Emilia & Harriet

XML Research Seminar: User Profiling for Personalization

-
Add to Calendar XML Research Seminar: User Profiling for PersonalizationThe Buttery
Location
The Buttery
Speakers
Dr Huizhi Liang
Event price
Free (coffee, tea, and cake provided)
Booking Required
Not Required
Accessibility
There is provision for wheelchair users.

Abstract: Personalization is to provide information or services that are tailed to individual users. User profiling is a critical component of Personalization. How to profile users’ preferences, interests, and human level attributes such as personality accurately to facilitate effective personalization remains an open research topic. This talk will present our recent work in profiling information system users and literature characters for personalized item recommendation and dialogue generation. We proposed novel data mining and machine learning techniques including reinforcement learning, graph learning, Natural Language Processing on various types of modality data including rating, tags, review, item images, temporal information, and relations. Experiments were conducted on large-scale real-world datasets from online communities such as IMDB and Amazon and literature books.



Bio: Dr. Huizhi (Elly) Liang is a senior Lecturer at the School of Computing, Newcastle University, UK. Huizhi received her PhD degree from the Queensland University of Technology, Australia. Before joining Newcastle University in 2022, she worked at University of Reading, LIP6, Pierre et Marie Curie University and French National Center for Scientific Research (CNRS), University of Melbourne, and Australian National University. Her research interests include Data Mining, Machine Learning, NLP, Dialogue Agents, Personalization, Recommender Systems.



This is a hybrid meeting. Please find the Teams link on XML webpage https://users.ox.ac.uk/~ndog0178/XML/xml_index.html.

5 minutes.jpg

AWRC Early Career Research Festival: 5-Minute Presentation Challenge

-
Add to Calendar AWRC Early Career Research Festival: 5-Minute Presentation ChallengeThe Buttery
Location
The Buttery
Speakers
Lara Bampfield (Assyriology/Digital Humanities), Mridulla Gullapalli (Ancient History), Adriana Molina Munoz (Historical Linguistics/Sanskrit), and Nathan Websdale (Late Antique/ Medieval History).
Booking Required
Not Required
The four speakers in this event will have 5 slides and 5 minutes to start a conversation about aspects of their research, each followed by 15 minutes of conversation. The speakers are:



Lara Bampfield (Assyriology/Digital Humanities), Mridulla Gullapalli (Ancient History), Adriana Molina Muñoz (Historical Linguistics/Sanskrit), and Nathan Websdale (Late Antique/ Medieval History).



The event will be catered with wine, soft drinks and nibbles.
004 - Purple Medium.png

Writing Jewish Women’s Lives Seminar: Losing the Dead and Other Writerly Intimacies

-
Add to Calendar Writing Jewish Women’s Lives Seminar: Losing the Dead and Other Writerly IntimaciesThe Buttery
Location
The Buttery
Speakers
Lisa Appignanesi and Devorah Baum
Event price
Free
Booking Required
Required

At the core of OCLW's new programme on Writing Jewish Women's Lives, our new series of afternoon literary seminars are a chance to discuss books by and about Jewish women. At this seminar we welcome authors Lisa Appignanesi and Devorah Baum to talk about loss and grief, love and laughter, and being Jewish.



Losing the Dead is Lisa’s profound memoir of the time she returned to Poland on a quest to seek out her mother’s wartime secrets at the very moment when her mother’s own memory was getting lost to Alzheimer’s. In so doing, Lisa was led to reflect on the secrets of her own past and identity formations. Devorah, who happens to be Lisa's daughter-in-law, draws on some related tropes of memoir and psychoanalysis in her writing and film-making. In this conversation, Lisa and Devorah will discuss Losing the Dead and then, more generally, the role played by familial stories in their work.

Register here 

Law in Societies Cluster Lecture: Is There Such Thing as Islamic Law?

-
Add to Calendar Law in Societies Cluster Lecture: Is There Such Thing as Islamic Law?The Buttery
Location
The Buttery
Speakers
PROFESSOR BAUDOUIN DUPRET

Baudouin Dupret is a Research Director at the Centre National de la Recherche Scientifique (CNRS). He is also a lecturer in Islamic law at the University of Louvain.

In his work, Professor Dupret combines approaches from Law, Islamic Studies, and Anthropology to study how law functions in practice within Muslim environments. Over the course of his career, he has spent many years in Egypt, Syria, and Morocco.

His most recent book, Positive Law from the Muslim World (2021, CUP), explores the extent to which the concept of law can be expanded beyond the context of positive state law.

 

Khentrul Rinpoche2.jpg

Songs of Spiritual Realization

-
Add to Calendar Songs of Spiritual RealizationThe Buttery
Location
The Buttery
Speakers
Khentrul Lodrö Thayé
Booking Required
Not Required
Called doha in Sanskrit, these songs spontaneously burst forth from realized Buddhist masters of India and Tibet without any thought or deliberation over composition. They simply spill from the mouths of such masters as an expression of their realization. Such songs of wisdom contain profound messages about the nature of reality and typically arise in metered verse in a variety of melodies. Those who hear the words will understand the meaning according to their capacity, and the songs will lead each listener to their own insights and wisdom.



Join us for an evening with Khentrul Lodrö Thayé Rinpoche, renowned monk and scholar, and author of the recently published book, The Power of Mind: A Tibetan Monk's Guide to Finding Freedom in Every Challenge, for a discussion on these songs of realization, their history and importance. Rinpoche will explain one chosen song and sing it in its original language and melody.
smaller clock.jpg

AWRC Early Career Research Festival: The 5-Minute Presentation Challenge

-
Add to Calendar AWRC Early Career Research Festival: The 5-Minute Presentation ChallengeThe Buttery
Location
The Buttery
Speakers
Mary Hitchman (Medieval History), Isabella Jäger (Classical Archaeology), Tim Moller (Ancient History), Alessandro Zammataro (Medieval Literature)
Booking Required
Not Required
The four speakers in this event will each have 5 slides and 5 minutes to start a conversation about aspects of their research, with each presentation followed by 15 minutes of conversation. The presentations will be followed by a drinks reception in the Buttery
955e3e30-791b-40a1-a519-dceeef75a8a7.png

Know Your World: Climate Change & Human Health

-
Add to Calendar Know Your World: Climate Change & Human HealthThe Buttery
Location
The Buttery
Speakers
Dr Maria Goddard
Event price
free
Booking Required
Not Required
Join us for the first event of the 'Know Your World' lecture series, run this year by Wolfson's Earth Emergency Cluster to raise awareness and spark discussions on a range of climate related issues. To kick off the series we have guest speaker Dr Maria Goddard talking about the impacts of global warming on human health.



Talk abstract -

Climate change is the biggest threat to human health. Medical issues from eco-anxiety and stress to heat exhaustion, infectious diseases and pollution related cancers and ultimately from starvation, drought, displacement and war threaten to overwhelm us as a species. A review of the top to toe medical matters arising from a host of climate change issues from an NHS doctor, lifestyle physician and climate campaigner Dr Maria Goddard.