The papers that shaped modern science and AI
The ATLAS collaboration at the LHC reported the observation of a new neutral boson with a mass of approximately 126 GeV, exhibiting a statistical significance of 5.9 standard deviations, which is consistent with the properties of the Standard Model Higgs boson.
Imagine the universe is a giant, cosmic puzzle.…
The CMS experiment at the LHC observed a new boson with a mass of approximately 125 GeV in proton-proton collisions, characterized by a 5.0 standard deviation significance and decay modes consistent with the Standard Model Higgs boson.
Imagine the universe is a giant, cosmic puzzle.…
This paper reports the first direct detection of gravitational waves on September 14, 2015, originating from the merger of a binary stellar-mass black hole system, a discovery that confirms the existence of such binaries and validates key predictions of general relativity.
# The Universe's First "Scream": A Simple Explanation of GW150914 Imagine the universe as a giant, invisible trampoline made of space and time.…
The Event Horizon Telescope collaboration successfully imaged the supermassive black hole at the center of galaxy M87, revealing a bright asymmetric ring surrounding a dark shadow consistent with general relativity predictions and enabling a precise mass measurement of approximately 6.5 billion solar masses.
Imagine trying to take a photograph of a ghost that is so heavy it bends the very fabric of space around it, but the ghost itself is invisible because it swallows all light.…
This paper introduces the Transformer, a novel neural network architecture that relies entirely on attention mechanisms while eliminating recurrence and convolutions, demonstrating superior translation quality, faster training times, and strong generalization to other tasks compared to existing state-of-the-art models.
Imagine you are trying to translate a book from English to German.…
This paper introduces a residual learning framework that reformulates network layers to learn residual functions, enabling the successful training of extremely deep neural networks (up to 152 layers) that significantly outperform previous models and achieved first place in multiple 2015 computer vision competitions.
Imagine you are trying to teach a student how to solve a very complex math problem.…
This paper proposes a new generative modeling framework based on a minimax two-player game between a generative model that captures data distribution and a discriminative model that distinguishes real from generated samples, which can be trained efficiently using backpropagation without Markov chains.
Imagine you are trying to teach a computer how to create art, music, or realistic photos.…
The paper introduces BERT, a novel bidirectional language representation model that leverages pre-training on unlabeled text to achieve state-of-the-art performance across a wide range of natural language processing tasks with minimal fine-tuning.
Imagine you are trying to teach a robot to understand human language.…
This paper presents high-quality image synthesis using denoising diffusion probabilistic models, achieving state-of-the-art results on CIFAR10 and LSUN datasets through a novel training objective connecting diffusion models to denoising score matching with Langevin dynamics.
Imagine you are trying to teach a computer to draw a picture of a cat.…
This paper introduces Adam, an efficient and memory-light stochastic optimization algorithm that uses adaptive moment estimates to effectively handle large-scale, noisy, and sparse gradient problems while offering strong theoretical convergence guarantees and competitive empirical performance.
Imagine you are trying to find the lowest point in a vast, foggy mountain range (the "optimal solution" for a machine learning problem).…
This paper introduces Batch Normalization, a technique that accelerates deep neural network training and improves performance by normalizing layer inputs to reduce internal covariate shift, thereby allowing for higher learning rates, better initialization robustness, and reduced reliance on regularization methods like Dropout.
Imagine you are trying to teach a team of 20 chefs (a **Deep Neural Network**) to cook a perfect steak.…
This paper introduces the Auto-Encoding Variational Bayes (AEVB) framework, which enables efficient stochastic variational inference and learning in directed probabilistic models with continuous latent variables by utilizing a reparameterized lower bound estimator and an approximate inference model to handle intractable posteriors and scale to large datasets.
Imagine you are trying to teach a robot to understand a massive library of books.…
This paper establishes that language model performance follows predictable power-law scaling relationships with model size, dataset size, and compute, revealing that optimal training efficiency is achieved by prioritizing very large models trained on modest data amounts rather than training smaller models to convergence.
Imagine you are trying to teach a robot to write like a human.…
This paper introduces the "dropout" technique, which randomly omits feature detectors during training to prevent complex co-adaptations and overfitting, thereby significantly improving neural network performance on tasks like speech and object recognition.
Imagine you are trying to teach a class of students how to recognize different animals.…
This paper introduces two novel, computationally efficient model architectures for learning high-quality continuous word vector representations from massive datasets, which achieve state-of-the-art performance in measuring syntactic and semantic word similarities at a fraction of the previous computational cost.
Imagine you are trying to teach a computer how to understand human language.…