The core idea: when you move from flat to hierarchical models, you're no longer estimating one set of parameters. You have local parameters that vary by location (or subject, or city) and global parameters that capture what's shared across all of them. And you don't just want each separately — you want the full joint posterior, because that's where the Bayesian magic of shrinkage actually lives.

Stefan builds the problem from the ground up. Start with the simplest hierarchical case: a two-level model. He uses electoral forecasting in France as the example — cities nested inside departments nested inside the whole country.

Now your simulator has to cover all three levels. If that simulator is slow (think: brain emulators, minutes per sample), scaling to hundreds of groups becomes completely intractable. Memory issues, specialized network requirements, the works.

The key insight: this problem has structure you can exploit. The joint posterior factorizes in a particularly nice way — each local parameter depends on its own local data and on the global parameters. That means instead of cramming everything into one giant high-dimensional vector and hoping a neural network figures it out, you can decompose the problem. Estimate local parameters conditioned on local data and the globals. Use composition.

The takeaway: hierarchical models aren't just "harder flat models" - they have a geometry that demands a different architecture. Respecting that structure is what makes amortized inference scale.

Get the full discussion here

Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work

Takeaways:

Q: What is simulation-based inference and what does "sim-to-real" mean?
A: Simulation-based inference (SBI) uses a mechanistic simulator as an epistemic tool: you train a neural network on a large number of labeled simulations and then deploy it on real, unlabeled data. The "sim-to-real" framing captures the key asymmetry -- your network never sees real data during training, only simulations, but it generalizes to real observations at inference time. This is the opposite of the more common "synthetic-for-ML" approach, where fake data is used purely to augment real training data.

Q: What is the amortized inference agent skill and what does it do?
A: It's an open-source AI agent skill, co-developed by Stefan and Alexandre, that teaches an AI coding agent to run a complete, state-of-the-art amortized inference workflow. Because amortized inference is recent enough that it's underrepresented in LLM training data, vanilla agents tend to get it wrong. The skill injects the right methodology: it guides the agent to set up the simulator, choose the right network architecture, run a pilot, train with appropriate diagnostics, and produce an actionable report -- without the user needing to know the details.

Q: What is calibration coverage and why should you never skip it?
A: Calibration coverage tells you whether your posterior uncertainty is honest -- whether your credible intervals actually contain the true parameter at the right frequency. A model can show poor parameter recovery yet still be well-calibrated (because it's falling back on the prior), or it can appear to recover parameters while being poorly calibrated. Running calibration diagnostics both in-sample and out-of-sample is especially revealing for hierarchical models, which often appear to underfit in-sample but generalize much better out-of-sample thanks to shrinkage.

Full takeaways here

Chapters:
00:00:00 How does amortized inference fit into the Bayesian workflow?
00:12:03 What does "sim-to-real" mean in simulation-based inference?
00:15:57 Why is amortized inference particularly suited to psychology and neuroscience?
00:21:51 What is the amortized inference agent skill?
00:39:00 What is calibration coverage and how do you interpret it?
00:41:50 How do you decide what to do next after your first training run?
00:44:53 How do actionable insights make Bayesian workflows more usable?
00:49:08 What are the unique challenges of hierarchical models in amortized inference?
01:00:51 What is the current state of BayesFlow's support for hierarchical models?
01:05:00 What are the main failure modes of amortized inference and how do you handle model misspecification?

Thank you to my Patrons for making this episode possible!

Links from the show

The core idea: when designing an experiment, you need a way to compare possible designs and pick the best one. EIG is that score - it tells you how much information you expect to gain about your model parameters from a given design. The higher the EIG, the better the design.

Adam builds intuition for EIG from two directions that sound completely different but lead to the same place. First, the Bayesian angle: simulate datasets from your prior predictive distribution, run inference on each, measure how much uncertainty dropped, and average across datasets. Second, a classic puzzle - the 12 prisoners balance scale problem - where the best weighing strategy turns out to be the one that makes all three outcomes (tip left, tip right, balance) equally likely. This maximizes outcome entropy, which is exactly what EIG does: it steers you toward designs where every possible result narrows down your hypotheses as fast as possible.

The takeaway: good experimental design isn't about intuition or convention - it's about making your data work as hard as possible, and EIG gives you a rigorous way to do that.

Get the full discussion here

Support & Resources
→ Support the show on Patreon
→ Bayesian Modeling Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work

Takeaways

Q: What is Bayesian experimental design and what problem does it solve?
A: It's the practice of using a Bayesian model to decide how to collect data before you collect it. Most statistical thinking starts with a fixed dataset. Bayesian experimental design sits upstream -- you have control over experimental parameters (which questions to ask, which reagents to mix, which conditions to test) and you want to choose them optimally. The Bayesian angle is to ask: what new data would most reduce my current uncertainty?

Q: When should you actually use Bayesian experimental design?
A: When two conditions hold: you have active control over how data is collected (not just passive observation), and you have a Bayesian model whose prior predictive distribution gives a reasonable picture of what typical data might look like. It's especially valuable when data collection is expensive or irreversible -- when the "committal step" of running an experiment has real cost, it's worth doing the analysis first.

Q: What is expected information gain (EIG) and why is it central to Bayesian experimental design?
A: EIG is the score you assign to a candidate experimental design -- the amount of information you expect to gain about your model parameters by running an experiment with that design. You compute it by simulating datasets from your prior predictive, doing Bayesian inference on each, and averaging how much the uncertainty decreased. What's remarkable is that you can derive the same quantity from two completely different starting points -- reducing parameter uncertainty, or maximizing outcome uncertainty while correcting for noise - and arrive at the same formula. That convergence is why EIG keeps being re-discovered independently across fields.

Full takeaways here

Chapters:

00:00 What is Bayesian experimental design and why does it matter?

00:06:02 What problem does Bayesian experimental design actually solve?

00:08:54 When should practitioners use Bayesian experimental design?

00:12:00 Is Bayesian experimental design changing how scientists work in practice?

00:15:04 What are the limitations of Bayesian experimental design?

00:17:55 What is expected information gain (EIG) and how does it work?

00:21:05 How do you compute expected information gain in practice?

00:23:48 What is active learning and how does it connect to Bayesian experimental design?

00:41:02 What is active learning by disagreement?

00:48:57 What is deep adaptive design and when should you00: use it?

00:56:02 How is Bayesian experimental design applied in protein dynamics and quantum chemistry?

01:01:58 What does a practical Bayesian experimental design workflow look like?

Thank you to my Patrons for making this episode possible!

Links from the show

The broader lesson: optimal decision-making requires separating the modeling process from the decision process, allowing you to build in constraints and risk adjustments that pure expected utility maximization would miss.

Get the full discussion here

Support & Resources
→ Support the show on Patreon: https://www.patreon.com/c/learnbayesstats
→ Bayesian Modeling Course (first 2 lessons free): https://topmate.io/alex_andorra/1011122

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Full takeaways here.

Chapters:

00:00:00 Introduction to Bayesian Inference and Its Barriers
00:03:51 Andreas Munch's Journey into Statistics
00:10:09 Bridging the Gap: Bayesian Inference in Real-World Applications
00:15:56 Deep Learning Meets Probabilistic Programming
00:22:05 Understanding Inference Compilation and Amortized Inference
00:28:14 Exploring PyProb: A Tool for Amortized Inference
00:33:55 Probabilistic Surrogate Networks and Their Applications
00:38:10 Building Surrogate Models for Probabilistic Programming
00:45:44 The Challenge of Bayesian Inference in Enterprises
00:52:57 Communicating Uncertainty to Stakeholders
01:01:09 Democratizing Bayesian Inference with Evara
01:06:27 Insurance Pricing and Latent Variables
01:16:41 Modeling Uncertainty in Predictions
01:20:29 Dynamic Inference and Decision-Making
01:23:17 Updating Models with Actual Data
01:26:11 The Future of Bayesian Sampling in Excel
01:31:54 Navigating Business Challenges and Growth
01:36:40 Exploring Language Models and Their Applications
01:38:35 The Quest for Better Inference Algorithms
01:41:01 Dinner with Great Minds: A Thought Experiment

Thank you to my Patrons for making this episode possible!

Links from the show here.

In this conversation, Thomas Pinder explains how Bayesian methods naturally lend themselves to causal modeling, and why that matters for real-world business decisions. The key insight is that causal questions in industry are rarely black and white: instead of a single treatment effect, you get a full posterior distribution, credible intervals, and the ability to communicate the probability that an effect is positive, which is far more useful to stakeholders than a p-value.

Thomas then dives into Bayesian Synthetic Control, a reframing of the classic synthetic control method from a constrained optimization problem into a Bayesian regression problem. Rather than optimizing weights on a simplex, you place a Dirichlet prior on the regression coefficients, which turns out to be not just mathematically elegant but practically richer: you can express prior beliefs about how many control units are informative, set the concentration parameter accordingly, or let a gamma hyperprior on that parameter let the data decide. The result is a more flexible, less fragile counterfactual, implemented cleanly in PyMC or NumPyro.

Get the full discussion here

Support & Resources
→ Support the show on Patreon: https://www.patreon.com/c/learnbayesstats
→ Bayesian Modeling Course (first 2 lessons free): https://topmate.io/alex_andorra/1011122

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

• Bayesian Modeling course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Takeaways:

Q: Why was GPJax created and how does it benefit researchers?
A: GPJax was developed to provide a high-performance, flexible framework for Gaussian processes (GPs) within the JAX ecosystem. It allows researchers to move beyond black-box implementations and easily experiment with custom kernels and model structures while leveraging JAX’s automatic differentiation and GPU acceleration.

Q: What are the primary advantages of using Gaussian processes for data modeling?
A: Gaussian processes are highly effective at modeling complex, nonlinear relationships in data. Unlike many machine learning methods that only provide a point estimate, GPs offer built-in uncertainty quantification, which is essential for understanding the reliability of predictions in research and industry.

Q: How does the GPJax and NumPyro integration enhance probabilistic modeling?
A: The integration allows users to treat GPJax models as components within a larger NumPyro probabilistic program. This combination enables the use of advanced sampling techniques like NUTS (No-U-Turn Sampler), making it easier to build and fit complex hierarchical models that include Gaussian processes.

Q: What are the main challenges when applying Gaussian processes to high-dimensional data?
A: High-dimensional data significantly complicates GP modeling due to the curse of dimensionality and the cubic scaling of computational costs. In high dimensions, defining meaningful distance metrics for kernels becomes harder, often requiring specialized techniques like sparse GPs or dimensionality reduction to remain tractable.

Full takeaways here!

Chapters:

11:40 What is GPJax and how does it simplify Gaussian Process modeling?
15:48 How are Bayesian methods used for experimentation and causal inference in industry?
18:40 How do you implement Bayesian Synthetic Control?
32:17 What is Bayesian Synthetic Difference-in-Differences?
39:44 What are the research applications and supported methods for the GPJax library?
45:47 What are the primary software and computational bottlenecks when scaling Gaussian Processes?
49:02 What are the real-world industrial applications of Gaussian Process models?
54:36 How is Bayesian modeling applied to soccer and sports analytics?
58:43 What is the future development roadmap for the GPJax ecosystem?
01:05:37 What is Impulso and how does it integrate into a Bayesian modeling workflow?
01:13:42 How do you balance Bayesian computational overhead with industrial latency requirements?
01:20:26 Why is there optimism that scalable Bayesian methods for causal inference are now within reach?

Thank you to my Patrons for making this episode possible!

Links from the show here!

• Bayesian Modeling course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Takeaways:

Q: Is generosity a natural human trait?
A: Yes, generosity is hardwired in our brains and is essential for social interaction.

Q: Why do people say they care about causes but not act on it?
A: There is often a disconnect between stated care for causes and actual action. Understanding the conditions under which generosity aligns with a person's identity is crucial for bridging this gap.

Q: How should fundraising efforts be approached?
A: Fundraising should primarily focus on belief updating rather than mere persuasion.

Q: What are the benefits of being generous?
A: Generosity has significant mental and physical health benefits, as the brain's reward systems activate when we give, making us feel good.

Q: How do our beliefs relate to our actions?
A: Our beliefs about ourselves strongly influence our actions and decisions, including our decision to be generous.

Q: Can generosity impact a community?
A: Yes, generosity can be a powerful tool for improving community dynamics.

Q: How can technology like AI assist institutions with donors?
A: AI could help institutions remember donors better, improving the donor-institution relationship.

Chapters:

00:00 What's the role of Behavioral Science inPhilanthropy
19:57 What is The Neuroscience of Generosity?
24:40 How can we best understand Donor Decision-Making?
32:14 How can we achieve reframe Beliefs and Actions?
35:39 What is the role of Identity in Habit Formation?
38:06 What is the Generosity Gap in Philanthropy?
45:06 How can we reduce Friction in Donation Processes?
48:27 What is the role of AI and Trust in Nonprofits?
52:11 How can we build Predictive Models for Donor Behavior?
55:41 What is the role of Empathy in Sales and Stakeholder Engagement?
01:00:46 How can we best align ideas with Stakeholder Beliefs?
01:02:06 How can we explore Generosity and Memory?

Thank you to my Patrons for making this episode possible!

Links from the show:

• Come meet Alex at the Field of Play Conference in Manchester, UK, March 27, 2026! https://www.fieldofplay.co.uk/
• Bayesian workflow agent skill
• Neurogiving, The Science of Donor Decision-Making
• Cherian's website
• Cherian's press kit
• LBS #89 Unlocking the Science of Exercise, Nutrition & Weight Management, with Eric Trexler

• Proudly sponsored by PyMC Labs!

• Intro to Bayes and Advanced Regression courses (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Chapters:

00:00 The Importance of Decision-Making in Data Science

06:41 From Philosophy to Bayesian Statistics

14:57 The Role of Soft Skills in Data Science

18:19 Understanding Decision Theory Workflows

22:43 Shifting Focus from Accuracy to Business Value

26:23 Leveraging PyTensor for Optimization

34:27 Applying Optimal Decision-Making in Industry

40:06 Understanding Utility Functions in Regulation

41:35 Introduction to Obeisance Decision Theory Workflow

42:33 Exploring Price Elasticity and Demand

45:54 Optimizing Profit through Bayesian Models

51:12 Risk Aversion and Utility Functions

57:18 Advanced Risk Management Techniques

01:01:08 Practical Applications of Bayesian Decision-Making

01:06:54 Future Directions in Bayesian Inference

01:10:16 The Quest for Better Inference Algorithms

01:15:01 Dinner with a Polymath: Herbert Simon

Thank you to my Patrons for making this episode possible!

Links from the show:

• Come meet Alex at the Field of Play Conference in Manchester, UK, March 27, 2026! https://www.fieldofplay.co.uk/
• A Bayesian decision theory workflow
• Daniel's website, LinkedIn and GitHub
• LBS #124 State Space Models & Structural Time Series, with Jesse Grabowski
• LBS #123 BART & The Future of Bayesian Tools, with Osvaldo Martin
• LBS #74 Optimizing NUTS and Developing the ZeroSumNormal Distribution, with Adrian Seyboldt
• LBS #76 The Past, Present & Future of Stan, with Bob Carpenter

• Proudly sponsored by PyMC Labs!

• Intro to Bayes and Advanced Regression courses (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Chapters:
00:00 Exploring Generative AI and Scientific Modeling
10:27 Understanding Simulation-Based Inference (SBI) and Its Applications
15:59 Diffusion Models in Simulation-Based Inference
19:22 Live Coding Session: Implementing Baseflow for SBI
34:39 Analyzing Results and Diagnostics in Simulation-Based Inference
46:18 Hierarchical Models and Amortized Bayesian Inference
48:14 Understanding Simulation-Based Inference (SBI) and Its Importance
49:14 Diving into Diffusion Models: Basics and Mechanisms
50:38 Forward and Backward Processes in Diffusion Models
53:03 Learning the Score: Training Diffusion Models
54:57 Inference with Diffusion Models: The Reverse Process
57:36 Exploring Variants: Flow Matching and Consistency Models
01:01:43 Benchmarking Different Models for Simulation-Based Inference
01:06:41 Hierarchical Models and Their Applications in Inference
01:14:25 Intervening in the Inference Process: Adding Constraints
01:25:35 Summary of Key Concepts and Future Directions

Thank you to my Patrons for making this episode possible!

Links from the show:

- Come meet Alex at the Field of Play Conference in Manchester, UK, March 27, 2026!
- Jonas's Diffusion for SBI Tutorial & Review (Paper & Code)
- The BayesFlow Library
- Jonas on LinkedIn
- Jonas on GitHub
- Further reading for more mathematical details: Holderrieth & Erives
- 150 Fast Bayesian Deep Learning, with David Rügamer, Emanuel Sommer & Jakob Robnik
- 107 Amortized Bayesian Inference with Deep Neural Networks, with Marvin Schmitt

• Proudly sponsored by PyMC Labs!

• Intro to Bayes and Advanced Regression courses (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Chapters:

00:00 Scaling Bayesian Neural Networks
04:26 Origin Stories of the Researchers
09:46 Research Themes in Bayesian Neural Networks
12:05 Making Bayesian Neural Networks Fast
16:19 Microcanonical Langevin Sampler Explained
22:57 Bottlenecks in Scaling Bayesian Neural Networks
29:09 Practical Tools for Bayesian Neural Networks
36:48 Trade-offs in Computational Efficiency and Posterior Fidelity
40:13 Exploring High Dimensional Gaussians
43:03 Practical Applications of Bayesian Deep Ensembles
45:20 Comparing Bayesian Neural Networks with Standard Approaches
50:03 Identifying Real-World Applications for Bayesian Methods
57:44 Future of Bayesian Deep Learning at Scale
01:05:56 The Evolution of Bayesian Inference Packages
01:10:39 Vision for the Future of Bayesian Statistics

Thank you to my Patrons for making this episode possible!

Come meet Alex at the Field of Play Conference in Manchester, UK, March 27, 2026!

Links from the show:

David Rügamer:
* Website
* Google Scholar
* GitHub

Emanuel Sommer:
* Website
* GitHub
* Google Scholar

Jakob Robnik:
* Google Scholar
* GitHub
* Microcanonical Langevin paper
* LinkedIn

• Proudly sponsored by PyMC Labs!

• Intro to Bayes and Advanced Regression courses (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Chapters:

11:37 The Hard Tech Era
21:08 The Shift in Tech Work Culture
28:49 AI's Impact on Job Security and Work Dynamics
34:33 Adapting to AI: Skills for the Future
45:56 Understanding AI Models and Their Limitations
47:25 The Importance of Diversity in AI Development
54:34 Positioning Technical Talent for Job Security
57:58 Building Resilience in Uncertain Times
01:06:33 Recognizing Diverse Ambitions in Career Progression
01:12:51 The Role of Managers in Employee Retention
01:26:55 Solving Complex Problems with AI and Innovation

Thank you to my Patrons for making this episode possible!

Links from the show:

• Alana's latest book (Use code BAYESIAN for 10% off + a free interview preparation download PDF)
• Alana’s Substack
• Alana on Linkedin
• Alana on Instagram
• The Obstacle Is the Way – The Timeless Art of Turning Trials into Triumph
• Courage Is Calling – Fortune Favours the Brave

In this conversation, Alex and Scott discuss emphasizing the shift from frequentist to Bayesian approaches in clinical trials.

They highlight the limitations of traditional trial designs and the advantages of adaptive and platform trials, particularly in the context of COVID-19 treatment.

The discussion provides insights into the complexities of trial design and the innovative methodologies that are shaping the future of medical research.

Get the full discussion here!

• Join this channel to get access to perks: https://www.patreon.com/c/learnbayesstats

• Intro to Bayes Course (first 2 lessons free): https://topmate.io/alex_andorra/503302

• Advanced Regression Course (first 2 lessons free): https://topmate.io/alex_andorra/1011122

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

• Proudly sponsored by PyMC Labs. Get in touch and tell them you come from LBS!

• Intro to Bayes and Advanced Regression courses (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Chapters:

13:16 Understanding Adaptive and Platform Trials

25:25 Real-World Applications and Innovations in Trials

34:11 Challenges in Implementing Bayesian Adaptive Trials

42:09 The Birth of a Simulation Tool

44:10 The Importance of Simulated Data

48:36 Lessons from High-Stakes Trials

52:53 Navigating Adaptive Trial Designs

56:55 Communicating Complexity to Stakeholders

01:02:29 The Future of Clinical Trials

01:10:24 Skills for the Next Generation of Statisticians

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Giuliano Cruz, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Aubrey Clayton, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Joshua Meehl, Javier Sabio, Kristian Higgins, Matt Rosinski, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire, Mike Loncaric, Ronald Legere, Sergio Dolia, Michael Cao, Yiğit Aşık, Suyog Chandramouli, Guillaume Berthon, Avenicio Baca, Spencer Boucher, Krzysztof Lechowski, Danimal, Jácint Juhász, Sander and Philippe.

Links from the show:

• Berry Consultants
• Scott's podcast
• LBS #45 Biostats & Clinical Trial Design, with Frank Harrell

We already mentioned multilevel regression and post-stratification (MRP, or Mister P) on this podcast, but we didn’t dedicate a full episode to explaining how it works, why it’s useful to deal with non-representative data, and what its limits are. Well, let’s do that now, shall we?

To that end, I had the delight to talk with Lauren Kennedy! Lauren is a lecturer in Business Analytics at Monash University in Melbourne, Australia, where she develops new statistical methods to analyze social science data. Working mainly with R and Stan, Lauren studies non-representative data, multilevel modeling, post-stratification, causal inference, and, more generally, how to make inferences from the social sciences.

Needless to say that I asked her everything I could about MRP, including how to choose priors, why her recent paper about structured priors can improve MRP, and when MRP is not useful. We also talked about missing data imputation, and how all these methods relate to causal inference in the social sciences.

If you want a bit of background, Lauren did her Undergraduates in Psychological Sciences and Maths and Computer Sciences at Adelaide University, with Danielle Navarro and Andrew Perfors, and then did her PhD with the same advisors. She spent 3 years in NYC with Andrew Gelman’s Lab at Columbia University, and then moved back to Melbourne in 2020. Most importantly, Lauren is an adept of crochet — she’s already on her third blanket!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege and Rémi Louf.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Lauren's website: https://jazzystats.com/
• Lauren on Twitter: https://twitter.com/jazzystats
• Lauren on GitHub: https://github.com/lauken13
• Improving multilevel regression and poststratification with structured priors: https://arxiv.org/abs/1908.06716
• Using model-based regression and poststratification to generalize findings beyond the observed sample: https://arxiv.org/abs/1906.11323
• Lauren's beginners Bayes workshop: https://github.com/lauken13/Beginners_Bayes_Workshop
• MRP in RStanarm:

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Aubrey Clayton, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Joshua Meehl, Javier Sabio, Kristian Higgins, Matt Rosinski, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire, Mike Loncaric, David McCormick, Ronald Legere, Sergio Dolia, Michael Cao, Yiğit Aşık, Suyog Chandramouli and Guillaume Berthon.

Takeaways:

• AI is reshaping the workplace, but we're still in early stages.
• Networking is crucial for job applications in top firms.
• AI tools can augment work but are not replacements for skilled labor.
• Understanding the tech landscape requires continuous learning.
• Timing and cultural readiness are key for tech innovations.
• Expertise can be gained without formal education.
• Bayesian statistics is a valuable skill for tech professionals.
• The importance of personal branding in the job market. You just need to know 1% more than the person you're talking to.
• Sharing knowledge can elevate your status within a company.
• Embracing chaos in tech can create new opportunities.
• Investing in people leads...

Proudly sponsored by PyMC Labs, the Bayesian Consultancy. Book a call, or get in touch!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Why GPs still matter: Gaussian Processes remain a go-to for function estimation, active learning, and experimental design – especially when calibrated uncertainty is non-negotiable.
• Scaling GP inference: Variational methods with inducing points (as in GPflow) make GPs practical on larger datasets without throwing away principled Bayes.
• MCMC in practice: Clever parameterizations and gradient-based samplers tighten mixing and efficiency; use MCMC when you need gold-standard posteriors.
• Bayesian deep learning, pragmatically: Stochastic-gradient training and approximate posteriors bring Bayesian ideas to neural networks at scale.
• Uncertainty that ships: Monte Carlo dropout and related tricks provide fast, usable uncertainty – even if they’re approximations.
• Model complexity ≠ model quality: Understanding capacity, priors, and inductive bias is key to getting trustworthy predictions.
• Deep Gaussian Processes: Layered GPs offer flexibility for complex functions, with clear trade-offs in interpretability and compute.
• Generative models through a Bayesian lens: GANs and friends benefit from explicit priors and uncertainty – useful for safety and downstream decisions.
• Tooling that matters: Frameworks like GPflow lower the friction from idea to implementation, encouraging reproducible, well-tested modeling.
• Where we’re headed: The future of ML is uncertainty-aware by default – integrating UQ tightly into optimization, design, and deployment.

Chapters:

08:44 Function Estimation and Bayesian Deep Learning

10:41 Understanding Deep Gaussian Processes

25:17 Choosing Between Deep GPs and Neural Networks

32:01 Interpretability and Practical Tools for GPs

43:52 Variational Methods in Gaussian Processes

54:44 Deep Neural Networks and Bayesian Inference

01:06:13 The Future of Bayesian Deep Learning

01:12:28 Advice for Aspiring Researchers

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Causal assumptions are crucial for statistical modeling.
• Deep learning can be integrated with causal models.
• Statistical rigor is essential in evaluating LLMs.
• Causal representation learning is a growing field.
• Inductive biases in AI should match key mechanisms.
• Causal AI can improve decision-making processes.
• The future of AI lies in understanding causal relationships.

Chapters:

00:00 Introduction to Causal AI and Its Importance

16:34 The Journey to Writing Causal AI

28:05 Integrating Graphical Causality with Deep Learning

40:10 The Evolution of Probabilistic Machine Learning

44:34 Practical Applications of Causal AI with LLMs

49:48 Exploring Multimodal Models and Causality

56:15 Tools and Frameworks for Causal AI

01:03:19 Statistical Rigor in Evaluating LLMs

01:12:22 Causal Thinking in Real-World Deployments

01:19:52 Trade-offs in Generative Causal Models

01:25:14 Future of Causal Generative Modeling

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Marcus Nölke, Maggi Mackintosh, Grant...

That’s where a field of economics, industrial organization (IO), can help, as Shosh Vasserman will tell us in this episode. Shosh is an assistant professor of economics at the Stanford Graduate School of Business. Specialized in industrial organization, her interests span a number of policy settings, such as public procurement, pharmaceutical pricing and auto-insurance.

Her work leverages theory, empirics and modern computation (including the Stan software!) to better understand the equilibrium implications of policies and proposals involving information revelation, risk sharing and commitment. 

In short, Shoshana uses theory and data to study how risk, commitment and information flows interplay with policy design. And she does a lot of this with… Bayesian models! Who said Bayes had no place in economics?

Prior to Stanford, Shoshana did her Bachelor’s in mathematics and economics at MIT, and then her PhD in economics at Harvard University.

This was a fascinating conversation where I learned a lot about Bayesian inference on large scale random utility logit models, socioeconomic network heterogeneity and pandemic policy response — and I’m sure you will too!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran and Paul Oreto.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Shosh's website: https://shoshanavasserman.com/
• Shosh on Twitter: https://twitter.com/shoshievass
• How do different reopening strategies balance health and employment: https://reopenmappingproject.com/
• Aggregate random coefficients logit—a generative approach: http://modernstatisticalworkflow.blogspot.com/2017/03/aggregate-random-coefficients-logita.html
• Voluntary Disclosure and Personalized Pricing: https://shoshanavasserman.com/files/2020/08/Voluntary-Disclosure-and-Personalized-Pricing.pdf
• Socioeconomic Network Heterogeneity and Pandemic Policy Response:

Alex, Haavard and Janet explore the world of Bayesian inference with INLA, a fast and deterministic method that revolutionizes how we handle large datasets and complex models.

Discover the power of INLA, and why it can make your models go much faster! Get the full conversation here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• INLA is a fast, deterministic method for Bayesian inference.
• INLA is particularly useful for large datasets and complex models.
• The R INLA package is widely used for implementing INLA methodology.
• INLA has been applied in various fields, including epidemiology and air quality control.
• Computational challenges in INLA are minimal compared to MCMC methods.
• The Smart Gradient method enhances the efficiency of INLA.
• INLA can handle various likelihoods, not just Gaussian.
• SPDs allow for more efficient computations in spatial modeling.
• The new INLA methodology scales better for large datasets, especially in medical imaging.
• Priors in Bayesian models can significantly impact the results and should be chosen carefully.
• Penalized complexity priors (PC priors) help prevent overfitting in models.
• Understanding the underlying mathematics of priors is crucial for effective modeling.
• The integration of GPUs in computational methods is a key future direction for INLA.
• The development of new sparse solvers is essential for handling larger models efficiently.

Chapters:

06:06 Understanding INLA: A Comparison with MCMC

08:46 Applications of INLA in Real-World Scenarios

11:58 Latent Gaussian Models and Their Importance

15:12 Impactful Applications of INLA in Health and Environment

18:09 Computational Challenges and Solutions in INLA

21:06 Stochastic Partial Differential Equations in Spatial Modeling

23:55 Future Directions and Innovations in INLA

39:51 Exploring Stochastic Differential Equations

43:02 Advancements in INLA Methodology

50:40 Getting Started with INLA

56:25 Understanding Priors in Bayesian Models

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• The hype around AI in science often fails to deliver practical results.
• Bayesian deep learning combines the strengths of deep learning and Bayesian statistics.
• Fine-tuning LLMs with Bayesian methods improves prediction calibration.
• There is no single dominant library for Bayesian deep learning yet.
• Real-world applications of Bayesian deep learning exist in various fields.
• Prior knowledge is crucial for the effectiveness of Bayesian deep learning.
• Data efficiency in AI can be enhanced by incorporating prior knowledge.
• Generative AI and Bayesian deep learning can inform each other.
• The complexity of a problem influences the choice between Bayesian and traditional deep learning.
• Meta-learning enhances the efficiency of Bayesian models.
• PAC-Bayesian theory merges Bayesian and frequentist ideas.
• Laplace inference offers a cost-effective approximation.
• Subspace inference can optimize parameter efficiency.
• Bayesian deep learning is crucial for reliable predictions.
• Effective communication of uncertainty is essential.
• Realistic benchmarks are needed for Bayesian methods
• Collaboration and communication in the AI community are vital.

Chapters:

00:00 Introduction to Bayesian Deep Learning

06:12 Vincent's Journey into Machine Learning

12:42 Defining Bayesian Deep Learning

17:23 Current Landscape of Bayesian Libraries

22:02 Real-World Applications of Bayesian Deep Learning

24:29 When to Use Bayesian Deep Learning

29:36 Data Efficient AI and Generative Modeling

31:59 Exploring Generative AI and Meta-Learning

34:19 Understanding Bayesian Deep Learning and Prior Knowledge

39:01 Algorithms for Bayesian Deep Learning Models

43:25 Advancements in Efficient Inference Techniques

49:35 The Future of AI Models and Reliability

52:47 Advice for Aspiring Researchers in AI

56:06 Future Projects and Research Directions

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade,...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• BART models are non-parametric Bayesian models that approximate functions by summing trees.
• BART is recommended for quick modeling without extensive domain knowledge.
• PyMC-BART allows mixing BART models with various likelihoods and other models.
• Variable importance can be easily interpreted using BART models.
• PreliZ aims to provide better tools for prior elicitation in Bayesian statistics.
• The integration of BART with Bambi could enhance exploratory modeling.
• Teaching Bayesian statistics involves practical problem-solving approaches.
• Future developments in PyMC-BART include significant speed improvements.
• Prior predictive distributions can aid in understanding model behavior.
• Interactive learning tools can enhance understanding of statistical concepts.
• Integrating PreliZ with PyMC improves workflow transparency.
• Arviz 1.0 is being completely rewritten for better usability.
• Prior elicitation is crucial in Bayesian modeling.
• Point intervals and forest plots are effective for visualizing complex data.

Chapters:

00:00 Introduction to Osvaldo Martin and Bayesian Statistics

08:12 Exploring Bayesian Additive Regression Trees (BART)

18:45 Prior Elicitation and the PreliZ Package

29:56 Teaching Bayesian Statistics and Future Directions

45:59 Exploring Prior Predictive Distributions

52:08 Interactive Modeling with PreliZ

54:06 The Evolution of ArviZ

01:01:23 Advancements in ArviZ 1.0

01:06:20 Educational Initiatives in Bayesian Statistics

01:12:33 The Future of Bayesian Methods

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire and Mike Loncaric.

Takeaways:

• The evolution of sports modeling is tied to the availability of high-frequency data.
• Bayesian methods are valuable in handling messy, hierarchical data.
• Communication between data scientists and decision-makers is crucial for effective model use.
• Models are often wrong, and learning from mistakes is part of the process.
• Simplicity in models can sometimes yield better results than complexity.
• The integration of analytics in sports is still developing, with opportunities in various sports.
• Transparency in research and development teams enhances decision-making.
• Understanding uncertainty in models is essential for informed decisions.
• The balance between point estimates and full distributions is a...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Bayesian statistics offers a robust framework for econometric modeling.
• State space models provide a comprehensive way to understand time series data.
• Gaussian random walks serve as a foundational model in time series analysis.
• Innovations represent external shocks that can significantly impact forecasts.
• Understanding the assumptions behind models is key to effective forecasting.
• Complex models are not always better; simplicity can be powerful.
• Forecasting requires careful consideration of potential disruptions. Understanding observed and hidden states is crucial in modeling.
• Latent abilities can be modeled as Gaussian random walks.
• State space models can be highly flexible and diverse.
• Composability allows for the integration of different model components.
• Trends in time series should reflect real-world dynamics.
• Seasonality can be captured through Fourier bases.
• AR components help model residuals in time series data.
• Exogenous regression components can enhance state space models.
• Causal analysis in time series often involves interventions and counterfactuals.
• Time-varying regression allows for dynamic relationships between variables.
• Kalman filters were originally developed for tracking rockets in space.
• The Kalman filter iteratively updates beliefs based on new data.
• Missing data can be treated as hidden states in the Kalman filter framework.
• The Kalman filter is a practical application of Bayes' theorem in a sequential context.
• Understanding the dynamics of systems is crucial for effective modeling.
• The state space module in PyMC simplifies complex time series modeling tasks.

Chapters:

00:00 Introduction to Jesse Krabowski and Time Series Analysis

04:33 Jesse's Journey into Bayesian Statistics

10:51 Exploring State Space Models

18:28 Understanding State Space Models and Their Components

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Effective data science education requires feedback and rapid iteration.
• Building LLM applications presents unique challenges and opportunities.
• The software development lifecycle for AI differs from traditional methods.
• Collaboration between data scientists and software engineers is crucial.
• Hugo's new course focuses on practical applications of LLMs.
• Continuous learning is essential in the fast-evolving tech landscape.
• Engaging learners through practical exercises enhances education.
• POC purgatory refers to the challenges faced in deploying LLM-powered software.
• Focusing on first principles can help overcome integration issues in AI.
• Aspiring data scientists should prioritize problem-solving over specific tools.
• Engagement with different parts of an organization is crucial for data scientists.
• Quick paths to value generation can help gain buy-in for data projects.
• Multimodal models are an exciting trend in AI development.
• Probabilistic programming has potential for future growth in data science.
• Continuous learning and curiosity are vital in the evolving field of data science.

Chapters:

09:13 Hugo's Journey in Data Science and Education

14:57 The Appeal of Bayesian Statistics

19:36 Learning and Teaching in Data Science

24:53 Key Ingredients for Effective Data Science Education

28:44 Podcasting Journey and Insights

36:10 Building LLM Applications: Course Overview

42:08 Navigating the Software Development Lifecycle

48:06 Overcoming Proof of Concept Purgatory

55:35 Guidance for Aspiring Data Scientists

01:03:25 Exciting Trends in Data Science and AI

01:10:51 Balancing Multiple Roles in Data Science

01:15:23 Envisioning Accessible Data Science for All

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• CFA is commonly used in psychometrics to validate theoretical constructs.
• Theoretical structure is crucial in confirmatory factor analysis.
• Bayesian approaches offer flexibility in modeling complex relationships.
• Model validation involves both global and local fit measures.
• Sensitivity analysis is vital in Bayesian modeling to avoid skewed results.
• Complex models should be justified by their ability to answer specific questions.
• The choice of model complexity should balance fit and theoretical relevance. Fitting models to real data builds confidence in their validity.
• Divergences in model fitting indicate potential issues with model specification.
• Factor analysis can help clarify causal relationships between variables.
• Survey data is a valuable resource for understanding complex phenomena.
• Philosophical training enhances logical reasoning in data science.
• Causal inference is increasingly recognized in industry applications.
• Effective communication is essential for data scientists.
• Understanding confounding is crucial for accurate modeling.

Chapters:

10:11 Understanding Structural Equation Modeling (SEM) and Confirmatory Factor Analysis (CFA)

20:11 Application of SEM and CFA in HR Analytics

30:10 Challenges and Advantages of Bayesian Approaches in SEM and CFA

33:58 Evaluating Bayesian Models

39:50 Challenges in Model Building

44:15 Causal Relationships in SEM and CFA

49:01 Practical Applications of SEM and CFA

51:47 Influence of Philosophy on Data Science

54:51 Designing Models with Confounding in Mind

57:39 Future Trends in Causal Inference

01:00:03 Advice for Aspiring Data Scientists

01:02:48 Future Research Directions

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy,

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Use mini-batch methods to efficiently process large datasets within Bayesian frameworks in enterprise AI applications.
• Apply approximate inference techniques, like stochastic gradient MCMC and Laplace approximation, to optimize Bayesian analysis in practical settings.
• Explore thermodynamic computing to significantly speed up Bayesian computations, enhancing model efficiency and scalability.
• Leverage the Posteriors python package for flexible and integrated Bayesian analysis in modern machine learning workflows.
• Overcome challenges in Bayesian inference by simplifying complex concepts for non-expert audiences, ensuring the practical application of statistical models.
• Address the intricacies of model assumptions and communicate effectively to non-technical stakeholders to enhance decision-making processes.

Chapters:

00:00 Introduction to Large-Scale Machine Learning

11:26 Scalable and Flexible Bayesian Inference with Posteriors

25:56 The Role of Temperature in Bayesian Models

32:30 Stochastic Gradient MCMC for Large Datasets

36:12 Introducing Posteriors: Bayesian Inference in Machine Learning

41:22 Uncertainty Quantification and Improved Predictions

52:05 Supporting New Algorithms and Arbitrary Likelihoods

59:16 Thermodynamic Computing

01:06:22 Decoupling Model Specification, Data Generation, and Inference

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work !

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways

• Bayesian methods align better with researchers' intuitive understanding of research questions and provide more tools to evaluate and understand models.
• Prior sensitivity analysis is crucial for understanding the robustness of findings to changes in priors and helps in contextualizing research findings.
• Bayesian methods offer an elegant and efficient way to handle missing data in longitudinal studies, providing more flexibility and information for researchers.
• Fit indices in Bayesian model selection are effective in detecting underfitting but may struggle to detect overfitting, highlighting the need for caution in model complexity.
• Bayesian methods have the potential to revolutionize educational research by addressing the challenges of small samples, complex nesting structures, and longitudinal data. 
• Posterior predictive checks are valuable for model evaluation and selection.

Chapters

00:00 The Power and Importance of Priors

09:29 Updating Beliefs and Choosing Reasonable Priors

16:08 Assessing Robustness with Prior Sensitivity Analysis

34:53 Aligning Bayesian Methods with Researchers' Thinking

37:10 Detecting Overfitting in SEM

43:48 Evaluating Model Fit with Posterior Predictive Checks

47:44 Teaching Bayesian Methods

54:07 Future Developments in Bayesian Statistics

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Communicating Bayesian concepts to non-technical audiences in sports analytics can be challenging, but it is important to provide clear explanations and address limitations.
• Understanding the model and its assumptions is crucial for effective communication and decision-making.
• Involving domain experts, such as scouts and coaches, can provide valuable insights and improve the model's relevance and usefulness.
• Customizing the model to align with the specific needs and questions of the stakeholders is essential for successful implementation. 
• Understanding the needs of decision-makers is crucial for effectively communicating and utilizing models in sports analytics.
• Predicting the impact of training loads on athletes' well-being and performance is a challenging frontier in sports analytics.
• Identifying discrete events in team sports data is essential for analysis and development of models.

Chapters:

00:00 Bayesian Statistics in Sports Analytics

18:29 Applying Bayesian Stats in Analyzing Player Performance and Injury Risk

36:21 Challenges in Communicating Bayesian Concepts to Non-Statistical Decision-Makers

41:04 Understanding Model Behavior and Validation through Simulations

43:09 Applying Bayesian Methods in Sports Analytics

48:03 Clarifying Questions and Utilizing Frameworks

53:41 Effective Communication of Statistical Concepts

57:50 Integrating Domain Expertise with Statistical Models

01:13:43 The Importance of Good Data

01:18:11 The Future of Sports Analytics

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways

• Convincing non-stats stakeholders in sports analytics can be challenging, but building trust and confirming their prior beliefs can help in gaining acceptance.
• Combining subjective beliefs with objective data in Bayesian analysis leads to more accurate forecasts.
• The availability of massive data sets has revolutionized sports analytics, allowing for more complex and accurate models.
• Sports analytics models should consider factors like rest, travel, and altitude to capture the full picture of team performance.
• The impact of budget on team performance in American sports and the use of plus-minus models in basketball and American football are important considerations in sports analytics.
• The future of sports analytics lies in making analysis more accessible and digestible for everyday fans.
• There is a need for more focus on estimating distributions and variance around estimates in sports analytics.
• AI tools can empower analysts to do their own analysis and make better decisions, but it's important to ensure they understand the assumptions and structure of the data.
• Measuring the value of certain positions, such as midfielders in soccer, is a challenging problem in sports analytics.
• Game theory plays a significant role in sports strategies, and optimal strategies can change over time as the game evolves.

Chapters

00:00 Introduction and Overview

09:27 The Power of Bayesian Analysis in Sports Modeling

16:28 The Revolution of Massive Data Sets in Sports Analytics

31:03 The Impact of Budget in Sports Analytics

39:35 Introduction to Sports Analytics

52:22 Plus-Minus Models in American Football

01:04:11 The Future of Sports Analytics

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

GPs are extremely powerful…. but hard to handle. One of the bottlenecks is learning the appropriate kernel. What if you could learn the structure of GP kernels automatically? Sounds really cool, but also a bit futuristic, doesn’t it?

Well, think again, because in this episode, Feras Saad will teach us how to do just that! Feras is an Assistant Professor in the Computer Science Department at Carnegie Mellon University. He received his PhD in Computer Science from MIT, and, most importantly for our conversation, he’s the creator of AutoGP.jl, a Julia package for automatic Gaussian process modeling.

Feras discusses the implementation of AutoGP, how it scales, what you can do with it, and how you can integrate its outputs in your models.

Finally, Feras provides an overview of Sequential Monte Carlo and its usefulness in AutoGP, highlighting the ability of SMC to incorporate new data in a streaming fashion and explore multiple modes efficiently.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell and Gal Kampel.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

- AutoGP is a Julia package for automatic Gaussian process modeling that learns the

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/101-black-holes-collisions-gravitational-waves-ligo-experts-christopher-berry-john-veitch/

Watch the interview: https://www.youtube.com/watch?v=ZaZwCcrJlik

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

You know I’m a big fan of everything physics. So when I heard that Bayesian stats was especially useful in quantum physics, I had to make an episode about it!

You’ll hear from Chris Ferrie, an Associate Professor at the Centre for Quantum Software and Information of the University of Technology Sydney. Chris also has a foot in industry, as a co-founder of Eigensystems, an Australian start-up with a mission to democratize access to quantum computing. 

Of course, we talked about why Bayesian stats are helpful in quantum physics research, and about the burning challenges in this line of research.

But Chris is also a renowned author — in addition to writing Bayesian Probability for Babies, he is the author of Quantum Physics for Babies and Quantum Bullsh*t: How to Ruin Your Life With Advice from Quantum Physics. So we ended up talking about science communication, science education, and a shocking revelation about Ant Man…

A big thank you to one of my best Patrons, Stefan Lorenz, for recommending me an episode with Chris!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

• Quantum computing has the...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

If you’ve ever tried to lose fat or gain muscle, you may have noticed… it’s not easy. But it’s precisely its complexity that makes the science of exercise and nutrition fascinating.

This is the longest LBS episode so far, and you’ll understand why pretty quickly: we covered a very wide range of topics, starting with the concept of metabolic adaptation and how our physiology and brain react to caloric deficits or caloric surpluses.

We also talked about the connection between metabolic adaptation and exercise energy compensation, shedding light on the interactions between the two, and how they make weight management more complex.

Statistics are of utmost importance in these endeavors, so of course we touched on how Bayesian stats can help mitigate the challenges of low sample sizes and over-focus on average treatment effect.

My guest for this marathon episode, is no other than Eric Trexler. Currently at the Department of Evolutionary Anthropology of Duke University, Eric conducts research on metabolism and cardiometabolic health. He has a PhD in Human Movement Science from UNC Chapel Hill, and has published dozens of peer-reviewed research papers related to exercise, nutrition, and metabolism.

In addition, Eric is a former professional bodybuilder and has been coaching clients with goals related to health, fitness, and athletics since 2009.

In other words, get comfy for a broad and nerdy conversation about the mysteries related to energy expenditure regulation, weight management, and evolutionary mechanisms underpinning current health challenges.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio

Listen on Podurama

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Today, we’re gonna learn about probabilistic numerics — what they are, what they are good for, and how they relate computation and inference in artificial intelligent systems.

To do this, I have the honor of hosting Philipp Hennig, a distinguished expert in this field, and the Chair for the Methods of Machine Learning at the University of Tübingen, Germany. Philipp studied in Heidelberg, also in Germany, and at Imperial College, London. Philipp received his PhD from the University of Cambridge, UK, under the supervision of David MacKay, before moving to Tübingen in 2011. 

Since his PhD, he has been interested in the connection between computation and inference. With international colleagues, he helped establish the idea of probabilistic numerics, which describes computation as Bayesian inference. His book, Probabilistic Numerics — Computation as Machine Learning, co-authored with Mike Osborne and Hans Kersting, was published by Cambridge University Press in 2022 and is also openly available online. 

So get comfy to explore the principles that underpin these algorithms, how they differ from traditional numerical methods, and how to incorporate uncertainty into the decision-making process of these algorithms.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar and Matt Rosinski.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Philipp on Twitter:...

We need to talk. I had trouble writing this introduction. Not because I didn’t know what to say (that’s hardly ever an issue for me), but because a conversation with Adrian Seyboldt always takes deliciously unexpected turns.

Adrian is one of the most brilliant, interesting and open-minded person I know. It turns out he’s courageous too: although he’s not a fan of public speaking, he accepted my invitation on this show — and I’m really glad he did!

Adrian studied math and bioinformatics in Germany and now lives in the US, where he enjoys doing maths, baking bread and hiking.

We talked about the why and how of his new project, Nutpie, a more efficient implementation of the NUTS sampler in Rust. We also dived deep into the new ZeroSumNormal distribution he created and that’s available from PyMC 4.2 onwards — what is it? Why would you use it? And when?

Adrian will also tell us about his favorite type of models, as well as what he currently sees as the biggest hurdles in the Bayesian workflow.

Each time I talk with Adrian, I learn a lot and am filled with enthusiasm — and now I hope you will too!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bert≈rand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey and Andreas Kröpelin.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• LBS on Twitter: https://twitter.com/LearnBayesStats
• LBS on Linkedin: https://www.linkedin.com/company/learn-bayes-stats/
• Adrian on GitHub: https://github.com/aseyboldt
• Nutpie repository:

I’m sure you’ve already heard of gravitational waves, because my listeners are the coolest and smartest ever ;) But did you know about gravity waves? That’s right, waves in the sky due to gravity — sounds awesome, right?

Well, I’m pretty sure that Laura Mansfield will confirm your prior. Currently a postdoc at Stanford University, Laura studies — guess what? — gravity waves and how they are represented in climate models. In particular, she uses Bayesian methods to estimate the uncertainty on the gravity wave components of the models.

Holding a PhD from the University of Reading in the UK, her background is in atmospheric physics, but she’s interested in climate change and environmental issues.

So seat back, chill out, and enjoy this physics-packed, aerial episode!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Lin Yu Sha and Scott Anthony Robson.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Laura on Twitter: https://twitter.com/lau_mansfield
• Laura’s webpage: https://profiles.stanford.edu/laura-mansfield
• Julia package for Gaussian Processes: https://github.com/STOR-i/GaussianProcesses.jl 
• Julia implementation of the scikit-learn API:

The behavioral and neural sciences are a nerdy interest of mine, but I didn’t dedicate any episode to that topic yet. But life brings you gifts sometimes (especially around Christmas…), and here that gift is a book, Bayesian Data Analysis for the Behavioral and Neural Sciences, by Todd Hudson.

Todd is a part of the faculty at New York University Grossman School of Medicine and also the New York University Tandon School of Engineering. He is a computational neuroscientist working in several areas including: early detection and grading of neurological disease; computational models of movement planning and learning; development of new computational and experimental techniques. 

He also co-founded Tactile Navigation Tools, which develops navigation aids for the visually impaired, and Third Eye Technologies, which develops low cost laboratory- and clinical-grade eyetracking technologies.

As you’ll hear, Todd wanted his book to bypass the need for advanced mathematics normally considered a prerequisite for this type of material. Basically, he wants students to be able to write code and models and understand equations, even they are not specialized in writing those equations.

We’ll also touch on some of the neural sciences examples he’s got in the book, as well as the two general algorithms he uses for model measurement and model selection.

Ow, I almost forgot the most important: Todd loves beekeeping and gardening — he’s got 25 apple trees, 4 cherry trees, nectarines, figs, strawberries, etc!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Alejandro Morales, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones and Daniel Lindroth.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• 30% discount on Todd's book by entering BDABNS22 at checkout:

I did receive some physicians already on the show, like Michael Betancourt in episode 6, but in my legendary ungratefulness I hadn’t dedicated a whole episode to talk about physics yet.

Well that’s now taken care of, thanks to JJ Ruby. Apart from having really good tastes (he’s indeed a fan of this very podcast), JJ is currently a postdoctoral fellow for the Center for Matter at Atomic Pressures at the University of Rochester, and will soon be starting as a Postdoctoral Scholar at Lawrence Livermore National Laboratory, a U.S. Department of Energy National Laboratory.

JJ did his undergraduate work in Astrophysics and Planetary Science at Villanova University, outside of Philadelphia, and completed his master’s degree and PhD in Physics at the University of Rochester, in New York.

JJ studies high energy density physics and focuses on using Bayesian techniques to extract information from large scale physics experiments with highly integrated measurements.

In his freetime, he enjoys playing sports including baseball, basketball, and golf.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin and Cameron Smith.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Center for Matter at Atomic Pressures: https://www.rochester.edu/cmap/
• Laboratory for Laser Energetics: https://www.lle.rochester.edu/index.php/about-the-laboratory-for-laser-energetics/
• Lawrence Livermore National Laboratory: https://www.llnl.gov/
• JJ's thesis -- Bayesian Inference of Fundamental Physics at Extreme Conditions: https://www.lle.rochester.edu/media/publications/documents/theses/Ruby.pdf
• Recent Fusion Breakthrough: https://www.llnl.gov/news/national-ignition-facility-experiment-puts-researchers-threshold-fusion-ignition
• LBS #6, A principled Bayesian...

A speech pathologist turned data scientist, TJ earned his PhD in communication sciences and disorders in Madison, Wisconsin. On paper, he was studying speech development, word recognition and word learning in preschoolers, but over the course of his graduate training, he discovered that he really, really likes programming and working with data – we’ll of course talk about that in the show!

In short, TJ wrangles data, crunches numbers, plots pictures, and fits models to study how children learn to speak and communicate. On his website, he often writes about Bayesian models, mixed effects models, functional programming in R, or how to plot certain kinds of data.

He also got very into the deck-building game “Slay the Spire” this year, and his favorite youtube channel is a guy who restores paintings.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, and Luis Iberico.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• TJ's website: https://www.tjmahr.com/
• TJ on Twitter: https://twitter.com/tjmahr
• TJ on GitHub: https://github.com/tjmahr
• LBS #40, Bayesian Stats for the Speech & Language Sciences: https://www.learnbayesstats.com/episode/40-bayesian-stats-speech-language-sciences-allison-hilger-timo-roettger
• Random Effects and Penalized Splines: https://www.tjmahr.com/random-effects-penalized-splines-same-thing/
• Bayes’s theorem in three panels: https://www.tjmahr.com/bayes-theorem-in-three-panels/
• Another mixed effects model visualization:

Allen is a professor at Olin College and the author of books related to software and data science, including Think Python, Think Bayes, and Think Complexity. His blog, Probably Overthinking It, features articles on Bayesian probability and statistics. He holds a Ph.D. from U.C. Berkeley, and bachelors and masters degrees from MIT.

In this special episode, Allen and I talked about his background, how he came to the stats and teaching worlds, and why he wanted to write this book in the first place. He’ll tell us who this book is written for, what’s new in the second edition, and which mistakes his students most commonly make when starting to learn Bayesian stats. We also talked about some types of models, their usefulness and their weaknesses, but I’ll let you discover that.

Now for another good news: 5 Patrons of the show will get Think Bayes for free! To qualify, you just need to go the form I linked to in the 'Learn Bayes Stats' Slack channel or the Patreon page and enter your email address. That’s it. After a week or so, Allen and I will choose 5 winners at random, who will receive the book for free!

If you’re not a Patron yet, make sure to check out patreon.com/learnbayesstats if you don’t want to miss out on these goodies!

And even if you’re not a Patron, I love you dear listeners, so you all get a discount when you go buy the book at https://www.learnbayesstats.com/buy-think-bayes (unfortunately, this only applies for purchases in the US and Canada).

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, John Johnson and Hector Munoz.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Give LBS a 5-star rating on Podchaser: https://www.podchaser.com/learnbayesstats
• Buy Think Bayes at a 40% discount with the code LBS40 (expires on July 31; only applies for purchases in the US and Canada): https://www.learnbayesstats.com/buy-think-bayes
• Think Bayes 2 online:...

Imagine me rapping: "Let me show you how to be a good Bayesian. Change your predictions after taking information in, and if you’re thinking I’ll be less than amazing, let’s adjust those expectations!"

What?? Nah, you’re right, I’m not as good as Baba Brinkman. Actually, the best to perform « Good Bayesian » live on the podcast would just be to invite him for an episode… Wait, isn’t that what I did???

Well indeed! For this episode, I had the great pleasure of hosting rap artist, science communicator and revered author of « Good Bayesian », Baba Brinkman!

We talked about his passion for oral poetry, his rap career, what being a good rapper means and the difficulties he encounters to establish himself as a proper rapper.

Baba began his rap career in 1998, freestyling and writing songs in his hometown of Vancouver, Canada.

In 2000 he started adapting Chaucer’s Canterbury Tales into original rap compositions, and in 2004 he premiered a one man show based on his Master’s thesis, The Rap Canterbury Tales, exploring parallels between hip-hop music and medieval poetry.

Over the years, Baba went on to create “Rap Guides” dedicated to scientific topics, like evolution, consciousness, medicine, religion, and climate change – and I encourage you to give them all a listen!

By the way, do you know the common point between rap and evolutionary biology? Well, you’ll have to tune in for the answer… And make sure you listen until the end: Baba has a very, very nice surprise for you!

A little tip: if you wanna enjoy it to the fullest, I put the unedited video version of this interview in the show notes ;) By the way, let me know if you like these video live streams — I might just do them again if you do!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski and Tim Radtke.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Video live-stream of the episode: https://www.youtube.com/watch?v=YkFXpP_SvHk
• Baba on Twitter: https://twitter.com/bababrinkman
• Baba on YouTube: https://www.youtube.com/channel/UCz9Qm66ewnY0LAlZlL4HK9g
• Baba on Spotify:

So, for the first episode of 2021, I have a special treat: I had the great pleasure of hosting Michael Lee on the podcast! Yes, the Michael Lee who co-authored the book Bayesian Cognitive Modeling with Eric-Jan Wagenmakers in 2013 — by the way, the book was ported to PyMC3, I put the link in the show notes ;)

This book was inspired from Michael’s work as a professor of cognitive sciences at University of California, Irvine. He works a lot on representation, memory, learning, and decision making, with a special focus on individual differences and collective cognition.

Using naturally occurring behavioral data, he builds probabilistic generative models to try and answer hard real-world questions: how does memory impairment work (that’s modeled with multinomial processing trees)? How complex are simple decisions, and how do people change strategies?

Echoing episode 18 with Daniel Lakens, Michael and I also talked about the reproducibility crisis: how are cognitive sciences doing, which progress was made, and what is still to do?

Living now in California, Michael is originally from Australia, where he did his Bachelors of Psychology and Mathematics, and his PhD in psychology. But Michael is also found of the city of Amsterdam, which he sees as “the perfect antidote to southern California with old buildings, public transport, great bread and beer, and crappy weather”.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll and Nathaniel Burbank.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Michael's website: https://faculty.sites.uci.edu/mdlee/
• Michael on GitHub: https://twitter.com/mdlBayes
• Bayesian Cognitive Modeling book: https://faculty.sites.uci.edu/mdlee/bgm/
• Bayesian Cognitive Modeling in PyMC3: https://github.com/pymc-devs/resources/tree/master/BCM
• An application of multinomial processing tree models and Bayesian methods to understanding memory impairment: https://drive.google.com/file/d/1NHml_YUsnpbUaqFhu0h8EiLeJCx6q403/view
• Understanding the Complexity of Simple...

So, Aki is an Associate professor in computational probabilistic modeling at Aalto University, Finland. You already heard his delightful Finnish accent on episode 20, with Andrew Gelman and Jennifer Hill, talking about their latest book, « Regression and other stories ». He is also a co-author of the popular and awarded book « Bayesian Data Analysis », Third Edition, and a core-developer of the seminal probabilistic programming framework Stan.

An enthusiast of open-source software, Aki is a core-contributor to the ArviZ package and has been involved in many free software projects such as GPstuff for Gaussian processes and ELFI for likelihood inference.

His numerous research interests are Bayesian probability theory and methodology, especially model assessment and selection, non-parametric models (such as Gaussian processes), feature selection, dynamic models, and hierarchical models.

We talked about all that — and more — on this episode, in the context of his teaching at Aalto and the software-assisted Bayesian workflow he’s currently working on with a group of researchers.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho and Colin Carroll.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• New podcast website: https://www.learnbayesstats.com/
• Rate LBS on Podchaser: https://www.podchaser.com/podcasts/learning-bayesian-statistics-932588
• Aki's website: https://users.aalto.fi/~ave/
• Aki's educational material: https://avehtari.github.io/
• Aki on GitHub: https://github.com/avehtari
• Aki on Twitter: https://twitter.com/avehtari
• Bayesian Data Analysis, 3rd edition: https://www.routledge.com/Bayesian-Data-Analysis/Gelman-Carlin-Stern-Dunson-Vehtari-Rubin/p/book/9781439840955
• Bayesian Data Analysis course material:

But how do these statistical models work? How do you account for the different sources of uncertainty, be it polling errors, unexpected turnout or media events? How do you model covariation between States? How do you even communicate the model’s results and afterwards assess its performance? To talk about all this, I had the pleasure to talk to Andrew Gelman and Merlin Heidemanns.

Andrew was already on episode 20, to talk about his recent book with Jennifer Hill and Aki Vehtari, “Regression and Other Stories”. He’s a professor of statistics and political science at Columbia University and works on a lot of topics, including: why campaign polls are so variable while elections are so predictable, the statistical challenges of estimating small effects, and methods for surveys and experimental design.

Merlin is a PhD student in Political Science at Columbia University, and he specializes in political methodology. Prior to his PhD, he did a Bachelor's in Political Science at the Freie Universität Berlin.

I hope you’ll enjoy this episode where we dove into the Bayesian model they helped develop for The Economist, and talked more generally about how to forecast elections with statistical methods, and even about the incentives the forecasting industry has as a whole.

Thank you to my Patrons for making this episode possible! Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Andrew's website: http://www.stat.columbia.edu/~gelman/
• Andrew's blog: https://statmodeling.stat.columbia.edu/
• Andrew on Twitter: https://twitter.com/statmodeling
• Merlin's website: https://merlinheidemanns.github.io/website/
• Merlin on Twitter: https://twitter.com/MHeidemanns
• The Economist POTUS forecast: https://projects.economist.com/us-2020-forecast/president
• How The Economist presidential forecast works: https://projects.economist.com/us-2020-forecast/president/how-this-works
• GitHub repo of the Economist model: https://github.com/TheEconomist/us-potus-model
• Information, incentives, and goals in election forecasts (Gelman, Hullman & Wlezien): http://www.stat.columbia.edu/~gelman/research/unpublished/forecast_incentives3.pdf
• How to think about extremely...

It’s been a while since we talked about biostatistics and bioinformatics on this podcast, so I thought it could be interesting to talk to Jacki Buros — and that was a very good idea!

She’ll walk us through examples of Bayesian models she uses to, for instance, work on biomarker discovery for cancer immunotherapies. She’ll also introduce you to survival models — their usefulness, their powers and their challenges.

Interestingly, all of this will highlight a handful of skills that Jacki would try to instill in her students if she had to teach Bayesian methods.

The Head of Data and Analytics at Generable, a state-of-the-art Bayesian platform for oncology clinical trials, Jacki has been working in biostatistics and bioinformatics for over 15 years. She started in cardiology research at the TIMI Study Group at Harvard Medical School before working in Alzheimer’s Disease genetics at Boston University and in biomarker discovery for cancer immunotherapies at the Hammer Lab. Most recently she was the Lead Biostatistician at the Institute for Next Generation Health Care at Mount Sinai.

An open-source enthusiast, Jacki is also a contributor to Stan and rstanarm, and the author of the survivalstan package, a library of Stan models for survival analysis.

Last but not least, Jacki is an avid sailor and skier!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt and Andrew Moskowitz.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Nominate "Learn Bayes Stats" as "Best Podcast of 2021" and "Best Tech Podcast" by entering its Apple feed in this form!
• Jacki on Twitter: https://twitter.com/jackiburos
• Jacki on GitHub: https://github.com/jburos
• Jacki on Orcid: https://orcid.org/0000-0001-9588-4889
• survivalstan -- Survival Models in Stan: https://github.com/hammerlab/survivalstan
• rstanarm -- R model-fitting functions using Stan:

Aubrey is a mathematician in Boston who teaches the philosophy of probability and statistics at the Harvard Extension School. He holds a PhD in mathematics from the University of California, Berkeley, and his writing has appeared in Pacific Standard, Nautilus, and the Boston Globe.

We talked about what he deems “a catastrophic error in the logic of the standard statistical methods in almost all the sciences” and why this error manifests even outside of science, like in medicine, law, public policy, etc.

But don’t worry, we’re not doomed — we’ll also see where we go from there. As a big fan of E.T Jaynes, Aubrey will also tell us how this US scientist influenced his own thinking as well as the field of Bayesian inference in general.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Alejandro Morales, Tomáš Frýda, Ryan Wesslen and Andreas Netti.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Aubrey's website: https://aubreyclayton.com/
• Aubrey on Twitter: https://twitter.com/aubreyclayton
• Bernoulli's Fallacy: https://aubreyclayton.com/bernoulli
• Aubrey's probability theory lectures based on E.T Jayne's work: https://www.youtube.com/playlist?list=PL9v9IXDsJkktefQzX39wC2YG07vw7DsQ_
• What Society Gets Wrong About Statistics: https://www.youtube.com/watch?v=fDulF2MzsIU
• The Prosecutor's Fallacy: https://en.wikipedia.org/wiki/Prosecutor%27s_fallacy
• The Theory That Would Not Die -- How Bayes' Rule Cracked the Enigma Code:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/96-pharma-models-sports-analytics-stan-news-daniel-lee/

Watch the interview: https://www.youtube.com/watch?v=lnq5ZPlup0E

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas and Luke Gorrie.

Well, you’ll be glad to hear there are tricks to make these models run, and one of these tricks is called re-parametrization — I bet you already heard about the poorly-named non-centered parametrization?

Well fear no more! In this episode, Maria Gorinova will tell you all about these model re-parametrizations! Maria is a PhD student in Data Science & AI at the University of Edinburgh. Her broad interests range from programming languages and verification, to machine learning and human-computer interaction. 

More specifically, Maria is interested in probabilistic programming languages, and in exploring ways of applying program-analysis techniques to existing PPLs in order to improve usability of the language or efficiency of inference.

As you’ll hear in the episode, she thinks a lot about the language aspect of probabilistic programming, and works on the automation of various “tricks” in probabilistic programming: automatic re-parametrization, automatic marginalization, automatic and efficient model-specific inference.

As Maria also has experience with several PPLs like Stan, Edward2 and TensorFlow Probability, she’ll tell us what she thinks a good PPL design requires, and what the future of PPLs looks like to her.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Maria on the Web: http://homepages.inf.ed.ac.uk/s1207807/index.html
• Maria on Twitter: https://twitter.com/migorinova
• Maria on GitHub: https://github.com/mgorinova
• Automatic Reparameterisation of Probabilistic Programs (Maria's paper with Dave Moore and Matthew Hoffman): https://arxiv.org/abs/1906.03028
• Stan User's Guide on Reparameterization: https://mc-stan.org/docs/2_23/stan-users-guide/reparameterization-section.html
• HMC for hierarchical models -- Background on reparameterization: https://arxiv.org/abs/1312.0906
• NeuTra -- Automatic reparameterization: https://arxiv.org/abs/1903.03704
• Edward2 -- A library for probabilistic modeling, inference, and criticism: http://edwardlib.org/
• Pyro -- Automatic reparameterization and marginalization: https://pyro.ai/
• Gen -- Programmable inference: http://probcomp.csail.mit.edu/software/gen/
• TensorFlow Probability: https://www.tensorflow.org/probability/

For this episode, I was happy to host Ehsan Bokhari, not only because he’s a first-hour listener of the podcast and spread the word about it whenever he can, but mainly because he knows baseball analytics very well!

Currently Senior Director of Strategic Decision Making with the Houston Astros, he previously worked there as Senior Director of Player Evaluation and Director of R&D. And before that, he was Senior Director at the Los Angeles Dodgers from the 2015 to the 2018 season.

Among other things, we talked about what his job looks like, how Bayesian the field is, which pushbacks he gets, and what the future of baseball analytics look like to him.

Ehsan also has an interesting background, coming from both psychology and mathematics. Indeed, he received a PhD in quantitative psychology and an MS in statistics at the University of Illinois in 2014.

Maybe most importantly, he loves reading non-fiction and spending time with his almost three-year-old son — who he read Bayesian Probability for Babies to, of course.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, and Alejandro Morales.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Ehsan on LinkedIn: https://www.linkedin.com/in/ebokhari/
• Bayesian Bagging to Generate Uncertainty Intervals -- A Catcher Framing Story: https://www.baseballprospectus.com/news/article/38289/bayesian-bagging-generate-uncertainty-intervals-catcher-framing-story/
• Jim Albert's Bayesball blog: https://bayesball.github.io/
• Simulation of empirical Bayesian methods, using baseball statistics: http://varianceexplained.org/r/simulation-bayes-baseball/
• Detection and Characterization of Cluster Substructure -- Fuzzy c-Lines: https://epubs.siam.org/doi/abs/10.1137/0140029
• Tensor rank decomposition:

Alex and David discuss the future of probabilistic programming, focusing on advancements in time series modeling, model selection, and the integration of AI in prior elicitation.

The discussion highlights the importance of setting appropriate priors, the challenges of computational workflows, and the potential of normalizing flows to enhance Bayesian inference.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

In this episode, I had the pleasure of speaking with Allen Downey, a professor emeritus at Olin College and a curriculum designer at Brilliant.org. Allen is a renowned author in the fields of programming and data science, with books such as "Think Python" and "Think Bayes" to his credit. He also authors the blog "Probably Overthinking It" and has a new book by the same name, which he just released in December 2023.

In this conversation, we tried to help you differentiate between right and wrong ways of looking at statistical data, discussed the Overton paradox and the role of Bayesian thinking in it, and detailed a mysterious Bayesian killer app!

But that’s not all: we even addressed the claim that Bayesian and frequentist methods often yield the same results — and why it’s a false claim. If that doesn’t get you to listen, I don’t know what will!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• LBS #41, Thinking Bayes, with Allen Downey: https://learnbayesstats.com/episode/41-think-bayes-allen-downey/
• Allen’s blog:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Getting Daniel Lee on the show is a real treat — with 20 years of experience in numeric computation; 10 years creating and working with Stan; 5 years working on pharma-related models, you can ask him virtually anything. And that I did…

From joint models for estimating oncology treatment efficacy to PK/PD models; from data fusion for U.S. Navy applications to baseball and football analytics, as well as common misconceptions or challenges in the Bayesian world — our conversation spans a wide range of topics that I’m sure you’ll appreciate!

Daniel studied Mathematics at MIT and Statistics at Cambridge University, and, when he’s not in front of his computer, is a savvy basketball player and… a hip hop DJ — you actually have his SoundCloud profile in the show notes if you’re curious!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas and Luke Gorrie.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Daniel on Linkedin: https://www.linkedin.com/in/syclik/
• Daniel on Twitter: https://twitter.com/djsyclik
• Daniel on GitHub: https://github.com/syclik
• Daniel's DJ profile:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

I love Bayesian modeling. Not only because it allows me to model interesting phenomena and learn about the world I live in. But because it’s part of a broader epistemological framework that confronts me with deep questions — how do you make decisions under uncertainty? How do you communicate risk and uncertainty? What does being rational even mean?

Thankfully, Gerd Gigerenzer is there to help us navigate these fascinating topics. Gerd is the Director of the Harding Center for Risk Literacy of the University of Potsdam, Germany.

Also Director emeritus at the Max Planck Institute for Human Development, he is a former Professor of Psychology at the University of Chicago and Distinguished Visiting Professor at the School of Law of the University of Virginia. 

Gerd has written numerous awarded articles and books, including Risk Savvy, Simple Heuristics That Make Us Smart, Rationality for Mortals, and How to Stay Smart in a Smart World.

As you’ll hear, Gerd has trained U.S. federal judges, German physicians, and top managers to make better decisions under uncertainty.

But Gerd is also a banjo player, has won a medal in Judo, and loves scuba diving, skiing, and, above all, reading.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau and Luis Fonseca.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

As you may know, I’m kind of a nerd. And I also love football — I've been a PSG fan since I’m 5 years old, so I’ve lived it all with this club.. And yet, I’ve never done a European-centered football analytics episode because, well, the US are much more advanced when it comes to sports analytics.

But today, I’m happy to say this day has come: a sports analytics episode where we can actually talk about European football. And that is thanks to Maximilan Göbel.

Max is a post-doctoral researcher in Economics and Finance at Bocconi University in Milan. Before that, he did his PhD in Economics at the Lisbon School of Economics and Management. 

Max is a very passionate football fan and played himself for almost 25 years in his local football club. Unfortunately, he had to give it up when starting his PhD — don’t worry, he still goes to the gym, or goes running and sometimes cycling.

Max is also a great cook, inspired by all kinds of Italian food, and an avid podcast listener — from financial news, to health and fitness content, and even a mysterious and entertaining Bayesian podcast…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau and Luis Fonseca.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Max’s website:

Listen on Podurama

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

I’ll be honest — this episode is long overdue. Not only because Ben Vincent is a friend, fellow PyMC Labs developer, and outstanding Bayesian modeler. But because he works on so many fascinating topics — so I’m all the happier to finally have him on the show!

In this episode, we’re gonna focus on causal inference, how it naturally extends Bayesian modeling, and how you can use the CausalPy open-source package to supercharge your Bayesian causal inference. We’ll also touch on marketing models and the pymc-marketing package, because, well, Ben does a lot of stuff ;)

Ben got his PhD in neuroscience at Sussex University, in the UK. After a postdoc at the University of Bristol, working on robots and active vision, as well as 15 years as a lecturer at the Scottish University of Dundee, he switched to the private sector, working with us full time at PyMC Labs — and that is a treat!

When he’s not working, Ben loves running 5k’s, cycling in the forest, lifting weights, and… learning about modern monetary theory.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony and Joshua Meehl.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Ben’s website: https://drbenvincent.github.io/
• Ben on GitHub: https://github.com/drbenvincent
• Ben on Twitter:

Listen on Podurama

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

This episode is unlike anything I’ve covered so far on the show. Let me ask you: Do you know what a research synchronous language is? What about hybrid systems? Last try: have you heard of Zelus, or ProbZelus?

If you answered “no” to one of the above, then you’re just like me! And that’s why I invited Guillaume Baudart for this episode — to teach us about all these fascinating topics!

A researcher in the PARKAS team of Inria, Guillaume's research focuses on probabilistic and reactive programming languages. In particular, he works on ProbZelus, a probabilistic extension to Zelus, itself a research synchronous language to implement hybrid systems.

To simplify, Zelus is a modeling framework to simulate the dynamics of systems both smooth and subject to discrete dynamics — if you’ve ever worked with ODEs, you may be familiar with these terms.

If you’re not — great, Guillaume will explain everything in the episode! And I know it might sound niche, but this kind of approach actually has very important applications — such as proving that there are no bugs in a program.

Guillaume did his PhD at École Normale Supérieure, in Paris, working on reactive programming languages and quasi-periodic systems. He then worked in the AI programming team of IBM Research, before coming back to the École Normale Supérieure, working mostly on reactive and probabilistic programming.

In his free time, Guillaume loves spending time with his family, playing the violin with friends, and… cooking!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

One of the greatest features of this podcast, and my work in general, is that I keep getting surprised. Along the way, I keep learning, and I meet fascinating people, like Tarmo Jüristo.

Tarmo is hard to describe. These days, he’s heading an NGO called Salk, in the Baltic state called Estonia. Among other things, they are studying and forecasting elections, which is how we met and ended up collaborating with PyMC Labs, our Bayesian consultancy.

But Tarmo is much more than that. Born in 1971 in what was still the Soviet Union, he graduated in finance from Tartu University. He worked in finance and investment banking until the 2009 crisis, when he quit and started a doctorate in… cultural studies. He then went on to write for theater and TV, teaching literature, anthropology and philosophy. An avid world traveler, he also teaches kendo and Brazilian jiu-jitsu.

As you’ll hear in the episode, after lots of adventures, he established Salk, and they just used a Bayesian hierarchical model with post-stratification to forecast the results of the 2023 Estonian parliamentary elections and target the campaign efforts to specific demographics.

Oh, and let thing: Tarmo is a fan of the show — I told you he was a great guy ;)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh and Grant Pezzolesi.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Tarmo on GitHub: https://github.com/tarmojuristo
• Tarmo on...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

------------------------------------------------------------------------------

Max Kochurov’s State of Bayes Lecture Series: https://www.youtube.com/playlist?list=PL1iMFW7frOOsh5KOcfvKWM12bjh8zs9BQ

Sign up here for upcoming lessons: https://www.meetup.com/pymc-labs-online-meetup/events/293101751/

------------------------------------------------------------------------------

We talk a lot about different MCMC methods on this podcast, because they are the workhorses of the Bayesian models. But other methods exist to infer the posterior distributions of your models — like Sequential Monte Carlo (SMC) for instance. You’ve never heard of SMC? Well perfect, because Nicolas Chopin is gonna tell you all about it in this episode!

A lecturer at the French university of ENSAE since 2006, Nicolas is one of the world experts on SMC. Before that, he graduated from Ecole Polytechnique and… ENSAE, where he did his PhD from 1999 to 2003.

Outside of work, Nicolas enjoys spending time with his family, practicing aikido, and reading a lot of books.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady and Kurt TeKolste.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Old episodes...

• Get early access to Alex's next live-cohort courses!
• Enroll in the Causal AI workshop, to learn live with Alex (15% off if you're a Patron of the show)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Causal inference is crucial for understanding the impact of interventions in various fields.
• ChiRho is a causal probabilistic programming language that bridges mechanistic and data-driven models.
• ChiRho allows for easy manipulation of causal models and counterfactual reasoning.
• The design of ChiRho emphasizes modularity and extensibility for diverse applications.
• Causal inference requires careful consideration of assumptions and model structures.
• Real-world applications of causal inference can lead to significant insights in science and engineering.
• Collaboration and communication are key in translating causal questions into actionable models.
• The future of causal inference lies in integrating probabilistic programming with scientific discovery.

Chapters:

05:53 Bridging Mechanistic and Data-Driven Models

09:13 Understanding Causal Probabilistic Programming

12:10 ChiRho and Its Design Principles

15:03 ChiRho’s Functionality and Use Cases

17:55 Counterfactual Worlds and Mediation Analysis

20:47 Efficient Estimation in ChiRho

24:08 Future Directions for Causal AI

50:21 Understanding the Do-Operator in Causal Inference

56:45 ChiRho’s Role in Causal Inference and Bayesian Modeling

01:01:36 Roadmap and Future Developments for ChiRho

01:05:29 Real-World Applications of Causal Probabilistic Programming

01:10:51 Challenges in Causal Inference Adoption

01:11:50 The Importance of Causal Claims in Research

01:18:11 Bayesian Approaches to Causal Inference

01:22:08 Combining Gaussian Processes with Causal Inference

01:28:27 Future Directions in Probabilistic Programming and Causal Inference

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad...

I bet you already heard of Bayesian nonparametric models, at least on this very podcast. We already talked about Dirichlet Processes with Karin Knudson on episode 4, and then about Gaussian Processes with Elizaveta Semenova on episode 21. Now we’re gonna dive into the mathematical properties of these objects, to understand them better — because, as you may know, Bayesian nonparametrics are quite powerful but also very hard to fit!

Along the way, you’ll learn about probabilistic circuits, sum-product networks and — what a delight — you’ll hear from the Julia community! Indeed, my guest for this episode is no other than… Martin Trapp!

Martin is a core developer of Turing.jl, an open-source framework for probabilistic programming in Julia, and a post-doc in probabilistic machine learning at Aalto University, Finland.

Martin loves working on sum-product networks and Bayesian non-parametrics. And indeed, his research interests focus on probabilistic models that exploit structural properties to allow efficient and exact computations while maintaining the capability to model complex relationships in data. In other words, Martin’s research is focused on tractable probabilistic models.

Martin did his MsC in computational intelligence at the Vienna University of Technology and just finished his PhD in machine learning at the Graz University of Technology. He doesn’t only like to study the tractability of probabilistic models — he also is very found of climbing!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen and Raul Maldonado.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Martin's website: https://trappmartin.github.io/
• Martin on GitHub: https://github.com/trappmartin
• Martin on Twitter: https://twitter.com/martin_trapp
• Turing, Bayesian inference with Julia: https://turing.ml/dev/
• Hierarchical Dirichlet Processes: https://people.eecs.berkeley.edu/~jordan/papers/hdp.pdf
• The Automatic Statistician:

One of the most common guest suggestions that you dear listeners make is… inviting Paul Bürkner on the show! Why? Because he’s a member of the Stan development team and he created BRMS, a popular R package to make and sample from Bayesian regression models using Stan. And, as I like you, I did invite Paul on the show and, well, that was a good call: we had an amazing conversation, spanning so many topics that I can’t list them all here!

I asked him why he created BRMS, in which fields it’s mostly used, what its weaknesses are, and which improvements to the package he’s currently working on. But that’s not it! Paul also gave his advice to people realizing that Bayesian methods would be useful to their research, but who fear facing challenges from advisors or reviewers.

Besides being a Bayesian rockstar, Paul is a statistician working as an Independent Junior Research Group Leader at the Cluster of Excellence SimTech at the University of Stuttgart, Germany. Previously, he has studied Psychology and Mathematics at the Universities of Münster and Hagen and did his PhD in Münster about optimal design and Bayesian data analysis, and he also worked as a Postdoctoral researcher at the Department of Computer Science at Aalto University, Finland.

So, of course, I asked him about the software-assisted Bayesian workflow that he’s currently working on with Aki Vehtari, which led us to no less than the future of probabilistic programming languages…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen and Jonathan Sedar.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Paul's website: https://paul-buerkner.github.io/about/
• Paul on Twitter: https://twitter.com/paulbuerkner
• Paul on GitHub: https://github.com/paul-buerkner
• BRMS docs: https://paul-buerkner.github.io/brms/
• Stan docs: https://mc-stan.org/
• Bayesian workflow paper: https://arxiv.org/pdf/2011.01808v1.pdf

Passionate about mathematics and statistics, Seth is finishing a PhD in bioinformatics at the Sali Lab of the University of California, San Francisco (UCSF). His research interests span the broad field of computational biology: using computer science, mathematics, and statistics to understand biological systems. His current research focuses on inferring protein structural ensembles. 

Open source development is also very dear to his heart, and indeed he contributes to many open source packages, especially in the Julia ecosystem. In particular, he develops and maintains ArviZ.jl, the Julia port of ArviZ, a platform-agnostic python package to visualize and diagnose your Bayesian models. Seth will tell us how he became involved in ArviZ.jl, what its strengths and weaknesses are, and how it fits into the Julia probabilistic programming landscape.

Ow, and as a bonus, you’ll discover why Seth is such a fan of automatic differentiation, aka « autodiff » — I actually wanted to edit this part out but Seth strongly insisted I kept it. Just kidding of course — or, am I… ?

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Seth website: http://sethaxen.com/
• Seth on Twitter: https://twitter.com/sethaxen
• Seth on GitHub: https://github.com/sethaxen
• ArviZ.jl -- Exploratory analysis of Bayesian models in Julia: https://arviz-devs.github.io/ArviZ.jl/dev/
• PyCon2020 -- Colin Carroll -- Getting started with automatic differentiation: https://www.youtube.com/watch?v=NG21KWZSiok

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran and Paul Oreto.

In this natural and beautiful — although slightly deer-infested — spot, Avi runs The Gradient Retreat Center, a place where writers, makers, and code writers can take a week away from their regular lives and focus on creative work. But it’s not only to envy him that I invited Avi on the show — it’s to talk about Bayesian inference in Scala, prior elicitation, how to deploy Bayesian methods at scale, and how to enable Bayesian inference for engineers. 

While working at Stripe, Avi wrote Rainier, a Bayesian inference framework for Scala. Inference is based on variants of the Hamiltonian Monte Carlo sampler, and the implementation is similar to, and targets the same types of models as both Stan and PyMC3. As Avi says, depending on your background, you might think of Rainier as aspiring to be either "Stan, but on the JVM", or "TensorFlow, but for small data".

In this episode, Avi will tell us how Rainier came into life, how it fits into the probabilistic programming landscape, and what its main strengths and weaknesses are.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Avi on Twitter: https://twitter.com/avibryant
• Avi on GitHub: https://github.com/avibryant
• Rainier -- Bayesian Inference in Scala: https://rainier.fit/
• The Gradient Retreat: https://gradientretreat.com/
• Facebook's Prophet: https://facebook.github.io/prophet/
• BAyesian Model-Building Interface (Bambi) in Python: https://bambinos.github.io/bambi/
• BRMS -- Bayesian regression models using Stan: https://paul-buerkner.github.io/brms/
• Using Bayesian Decision Making to Optimize Supply Chains -- Thomas Wiecki & Ravin Kumar: https://twiecki.io/blog/2019/01/14/supply_chain/

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran and Paul Oreto.

As every good fairy tale, this one had its share of villains — the traps where statistical methods fall and fail you; the terrible confounders, lurking in the dark; the ill-measured data that haunt your inferences! But once you defeat these monsters, you’ll be able to think about, build and interpret regression models.

This episode will be filled with stories — stories about linear regressions! Here to narrate these marvelous statistical adventures are Andrew Gelman, Jennifer Hill and Aki Vehtari — the authors of the brand new Regression and other Stories.

Andrew is a professor of statistics and political science at Columbia University. Jennifer is a professor of applied statistics at NYU. She develops methods to answer causal questions related to policy research and scientific development. Aki is an associate professor in computational probabilistic modeling at Aalto University, Finland.

In this episode, they tell us why they wrote this book, who it is for and they also give us their 10 tips to improve your regression modeling! We also talked about the limits of regression and about going to Mars…

Other good news: until October 31st 2020, you can go to http://www.cambridge.org/wm-ecommerce-web/academic/landingPage/GoodBayesian2020 and buy the book with a 20% discount by entering the promo code “GoodBayesian2020” upon checkout!

That way, you’ll make up your own stories before going to sleep and dream of a world where we can easily generalize from sample to population, and where multilevel regression with poststratification is a bliss…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Regression and Other Stories on Cambridge Press website: http://www.cambridge.org/wm-ecommerce-web/academic/landingPage/GoodBayesian2020
• Amazon page (because of VAT laws, in some regions ordering from Amazon can be cheaper than from the editor directly, even with the discount): https://www.amazon.com/Regression-Stories-Analytical-Methods-Research/dp/110702398X
• Code, data and examples for the book: https://avehtari.github.io/ROS-Examples/
• Port of the book in Python and Bambi: https://github.com/bambinos/Bambi_resources/tree/master/ROS
• Andrew's home page: http://www.stat.columbia.edu/~gelman/
• Andrew's blog: https://statmodeling.stat.columbia.edu/
• Andrew on Twitter: https://twitter.com/statmodeling
• Jennifer's home page:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/97-probably-overthinking-statistical-paradoxes-allen-downey/

Watch the interview: https://www.youtube.com/watch?v=KgesIe3hTe0

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Did you know that the way your brain perceives speed depends on your priors? And it’s not the same at night? And it’s not the same for everybody?

This is another of these episodes I love where we dive into neuroscience, how the brain works, and how it relates to Bayesian stats. It’s actually a follow-up to episode 77, where Pascal Wallisch told us how the famous black and blue dress tells a lot about our priors about how we perceive the world. So I strongly recommend listening to episode 77 first, and then come back here, to have your mind blown away again, this time by Alan Stocker.

Alan was born and raised in Switzerland. After a PhD in physics at ETH Zurich, he somehow found himself doing neuroscience, during a postdoc at NYU. And then he never stopped — still leading the Computational Perception and Cognition Laboratory of the University of Pennsylvania.

But Alan is also a man of music (playing the piano when he can), a man of coffee (he’ll never refuse an olympia cremina or a kafatek) and a man of the outdoors (he loves trashing through deep powder with his snowboard).

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady and Kurt TeKolste.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Alan’s website: https://www.sas.upenn.edu/~astocker/lab/members-files/alan.php
• Noise characteristics and prior expectations in human visual speed perception: https://www.nature.com/articles/nn1669
• Combining efficient coding with

I’m sure you know at least one Bart. Maybe you’ve even used one — but you’re not proud of it, because you didn’t know what you were doing. Thankfully, in this episode, we’ll go to the roots of regression trees — oh yeah, that’s what BART stands for. What were you thinking about?

Our tree expert will be no one else than Sameer Deshpande. Sameer is an assistant professor of Statistics at the University of Wisconsin-Madison. Prior to that, he completed a postdoc at MIT and earned his Ph.D. in Statistics from UPenn.

On the methodological front, he is interested in Bayesian hierarchical modeling, regression trees, model selection, and causal inference. Much of his applied work is motivated by an interest in understanding the long-term health consequences of playing American-style tackle football. He also enjoys modeling sports data and was a finalist in the 2019 NFL Big Data Bowl.

Outside of Statistics, he enjoys cooking, making cocktails, and photography — sometimes doing all of those at the same time…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, and Arkady.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Sameer’s website: https://skdeshpande91.github.io/
• Sameer on GitHub: https://github.com/skdeshpande91
• Sameer on Twitter: https://twitter.com/skdeshpande91 
• Sameer on Google Scholar: https://scholar.google.com/citations?user=coVrnWIAAAAJ&hl=en
• LBS #50 Ta(l)king Risks & Embracing...

I love dresses. Not on me, of course — I’m not nearly elegant enough to pull it off. Nevertheless, to me, dresses are one of the most elegant pieces of clothing ever invented.

And I like them even more when they change colors. Well, they don’t really change colors — it’s the way we perceive the colors that can change. You remember that dress that looked black and blue to some people, and white and gold to others? Well that’s exactly what we’ll dive into and explain in this episode.

Why do we literally see the world differently? Why does that even happen beyond our consciousness, most of the time? And cherry on the cake: how on Earth could this be related to… priors?? Yes, as in Bayesian priors!

Pascal Wallisch will shed light on all these topics in this episode. Pascal is a professor of Psychology and Data Science at New York University, where he studies a diverse range of topics including perception, cognitive diversity, the roots of disagreement and psychopathy.

Originally from Germany, Pascal did his undergraduate studies at the Free University of Berlin. He then received his PhD from the University of Chicago, where he studied visual perception.

In addition to scientific articles on psychology and neuroscience, he wrote multiple books on scientific computing and data science. As you’ll hear, Pascal is a wonderful science communicator, so it's only normal that he also writes for a general audience at Slate or the Creativity Post, and has given public talks at TedX and Think and Drink.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R and Nicolas Rode.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Pascal’s website: https://blog.pascallisch.net/about/
• Pascal on Twitter:

How does it feel to switch careers and start a postdoc at age 47? How was it to be one of the people who created the probabilistic programming language Stan? What should the Bayesian community focus on in the coming years?

These are just a few of the questions I had for my illustrious guest in this episode — Bob Carpenter. Bob is, of course, a Stan developer, and comes from a math background, with an emphasis on logic and computer science theory. He then did his PhD in cognitive and computer sciences, at the University of Edinburgh.

He moved from a professor position at Carnegie Mellon to industry research at Bell Labs, to working with Andrew Gelman and Matt Hoffman at Columbia University. Since 2020, he's been working at Flatiron Institute, a non-profit focused on algorithms and software for science.

In his free time, Bob loves to cook, see live music, and play role playing games — think Monster of the Week, Blades in Dark, and Fate.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bert≈rand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin and Raphaël R.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Bob’s website: https://bob-carpenter.github.io
• Bob on GitHub: https://github.com/bob-carpenter
• Bob on Google Scholar: https://scholar.google.com.au/citations?user=kPtKWAwAAAAJ&hl=en
• Stat modeling blog: https://statmodeling.stat.columbia.edu
• Stan home page: 

If you’re a nerd like me, you’re always curious about the physics of any situation. So, obviously, when I watched Top Gun 2, I became fascinated by the aerodynamics of fighters jets. And it so happens that one of my friends used to be a fighter pilot for the Canadian army… Immediately, I thought this would make for a cool episode — and here we are!

Actually, Jason Berndt wanted to be a pilot from the age of 3. When he was 6, he went to an air show, and then specifically wanted to become a fighter pilot. In his teens, he learned how to fly saliplanes, small single engine aircrafts. At age 22, he got a bachelor’s in aero engineering from the royal military college, and then — well, he’ll tell you the rest in the episode.

Now in his thirties, he owns real estate and created his own company, My Two Brows, selling temporary eyebrow tattoos — which, weirdly enough, is actually related to his time in the army…

In his free time, Jason plays the guitar, travels around the world (that’s actually how we met), and loves chasing adrenaline however he can (paragliding, scuba diving, you name it!).

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bert≈rand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin and Raphaël R.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• My Two Brows website: https://mytwobrows.com/
• My Two Brows on Instagram: https://www.instagram.com/my_two_brows/
• My Two Brows on YouTube: https://www.youtube.com/channel/UC6eQgQ4qoGE2RStDJkumUGg
• PyMC Labs Workshop – Hierarchical Bayesian Modeling of Survey Data with Post-stratification:

I’m guessing you already tried to communicate the results of a statistical model to non-stats people — it’s hard, right? I’ll be honest: sometimes, I even prefer to take notes during meetings than doing that… But shhh, that’s out secret.

But all of this was before. Before I talked with Jessica Hullman. Jessica is the Ginny Rometty associate professor of computer science at Northwestern University.

Her work revolves around how to design interfaces to help people draw inductive inferences from data. Her research has explored how to best align data-driven interfaces and representations of uncertainty with human reasoning capabilities, which is what we’ll mainly talk about in this episode.

Jessica also tries to understand the role of interactive analysis across different stages of a statistical workflow, and how to evaluate data visualization interfaces.

Her work has been awarded with multiple best paper and honorable mention awards, and she frequently speaks and blogs on topics related to visualization and reasoning about uncertainty — as usual, you’ll find the links in the show notes.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bert≈rand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox and Trey Causey.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

General links from the show:

• Jessica’s website: http://users.eecs.northwestern.edu/~jhullman/ 
• Jessica on Twitter: https://twitter.com/JessicaHullman
• Midwest Uncertainty Collective: https://mucollective.northwestern.edu/
• Jessica’s posts on Andrew Gelman’s blog:

Back in 2016, when I started dedicating my evenings and weekends to learning how to code and do serious stats, I was a bit lost… Where do I start? Which language do I pick? Why are all those languages just named with one single letter??

Then I found some stats classes by Justin Bois — and it was a tremendous help to get out of that wood (and yes, this was a pun). I really loved Justin’s teaching because he was making the assumptions explicit, and also explained them — which was so much more satisfying to my nerdy brain, which always wonders why we’re making this assumption and not that one.

So of course, I’m thrilled to be hosting Justin on the show today! Justin is a Teaching Professor in the Division of Biology and Biological Engineering at Caltech, California, where he also did his PhD. Before that, he was a postdoc in biochemistry at UCLA, as well as the Max Planck Institute in Dresden, Germany.

Most importantly for the football fans, he’s a goalkeeper — actually, the day before recording, he saved two penalty kicks… and even scored a goal! A big fan of Los Angeles football club, Justin is a also a magic enthusiast — he is indeed a member of the Magic Castle…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken and Or Duek.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Justin’s website: http://bois.caltech.edu/index.html 
• Justin on GitHub: https://github.com/justinbois/

Inviting someone like Luciano Paz on a stats podcast is both a pleasure and a challenge — he does so many things brilliantly that you have too many questions to ask him…

In this episode, I’ve chosen — not without difficulty — to focus on the applications of Bayesian stats in the marketing industry, especially Media Mix Models. Ok, I also asked Luciano about other topics — but you know me, I like to talk…

Originally, Luciano studied physics. He then did a PhD and postdoc in neuroscience, before transitioning into industry. During his time in academia, he used stats, machine learning and data science concepts here and there, but not in a very organized way.

But at the end of his postdoc, he got into PyMC — and that’s when everything changed… He loved the community and decided to hop on board to exit academia into a better life. After leaving academia, he worked at a company that wanted to do data science but that, for privacy reasons, didn’t have a lot of data. And now, Luciano is one of the folks working full time at the PyMC Labs consultancy.

But Luciano is not only one of the cool nerds building this crazy Bayesian adventures. He also did a lot of piano and ninjutsu. Sooooo, don’t provoke him — either in the streets or at a karaoke bar…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh and Lin Yu Sha.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Luciano’s website: https://lucianopaz.github.io/
• Luciano on GitHub:

I guess if you wanted to name this episode in a very Marvelian way, it would be “Bayes factors against the p-values of madness” — but we won’t do that, it wouldn’t be appropriate, would it?

Anyways, in this episode, I’ll talk about all these very light and consensual topics with Eric-Jan Wagenmakers, a professor at the Psychological Methods Unit of the University of Amsterdam.

For almost two decades, EJ has staunchly advocated the use of Bayesian inference in psychology. In order to lower the bar for the adoption of Bayesian methods, he is coordinating the development of JASP, an open-source software program that allows practitioners to conduct state-of-the-art Bayesian analyses with their mouse — the one from the computer, not the one from Disney.

EJ has also written a children’s book on Bayesian inference with the title “Bayesian thinking for toddlers”. Rumor has it that he is also working on a multi-volume series for adults — but shhh, that’s a secret!

EJ’s lab publishes regularly on a host of Bayesian topics, so check out his website, particularly when you are interested in Bayesian hypothesis testing. The same goes for his blog by the way, “BayesianSpectacles”.

Wait, what’s that? EJ is telling me that he plays chess, squash, and that, most importantly, he enjoys watching arm wrestling videos on YouTube — yet another proof that, yes, you can find everything on YouTube.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland and Aubrey Clayton.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• EJ’s website: http://ejwagenmakers.com/
• EJ on Twitter: https://twitter.com/EJWagenmakers
• “Bayesian Cognitive Modeling” book website:

Did you ever ask yourself that? Because J.P. de Ruiter did — and does everyday. But he’s got good reasons: JP is a cognitive scientist whose primary research focus is on the cognitive foundations of human communication. He aims to improve our understanding of how humans and artificial agents use language, gesture and other types of signals to effectively communicate with each other.

Currently he has one of the two Bridge Professorship at Tufts University, and has been appointed in both the Computer Science and Psychology departments.

In this episode, we’ll look at why Bayes is helpful in dialogue research, what the future of the field looks like to JP, and how he uses PyMC in his own teaching.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland and Aubrey Clayton.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• JP’s page: https://sites.tufts.edu/hilab/people/
• Projecting the End of a Speaker's Turn – A Cognitive Cornerstone of Conversation: https://www.researchgate.net/publication/236787756_Projecting_the_End_of_a_Speaker's_Turn_A_Cognitive_Cornerstone_of_Conversation
• Cognitive and social delays in the initiation of conversational repair: https://journals.uic.edu/ojs/index.php/dad/article/view/11388
• Using uh and um in spontaneous speaking: http://www.columbia.edu/~rmk7/HC/HC_Readings/Clark_Fox.pdf
• Status of Frustrator as an Inhibitor of Horn-Honking Responses: https://www.tandfonline.com/doi/abs/10.1080/00224545.1968.9933615
• A Simplest Systematics for the Organization of Turn-Taking for Conversation:

Well that’s not what happened with Ravin Kumar, Osvaldo Martin and Junpeng Lao — I was the one who suggested doing a special episode about their new book, Bayesian Modeling and Computation in Python. And since they cannot say no to my soothing French accent, well, they didn’t say no…

All of them were on the podcast already, so I’ll refer you to their solo episode for background on their background — aka backgroundception.

Junpeng is a Data Scientist at Google, living in Zurich, Switzerland. Previously, he was a post-doc in Psychology and Cognitive Neuroscience. His current obsessions are time series and state space models. 

Osvaldo is a Researcher at CONICET in Argentina and the Department of Computer Science from Aalto University in Finland. He is especially motivated by the development and implementation of software tools for Bayesian statistics and probabilistic modeling.

Ravin is a data scientist at Google, living in Los Angeles. Previously he worked at Sweetgreen and SpaceX. He became interested in Bayesian statistics when trying to quantify uncertainty in operations. He is especially interested in decision science in business settings.

You’ll make your own opinion, but I like their book because uses a hands-on approach, focusing on the practice of applied statistics. And you get to see how to use diverse libraries, like PyMC, Tensorflow Probability, ArviZ, Bambi, and so on. You’ll see what I’m talking about in this episode.

To top it off, the book is fully available online at bayesiancomputationbook.com. If you want a physical copy (because you love those guys and wanna support them), go to CRC website and enter the code ASA18 at checkout for a 30% discount.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland and Aubrey Clayton.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the...

Alex made us discover new methods, new ideas, and mostly new people. But what do we really know about him? Does he even really exist? To find this out I put on my Frenchest beret, a baguette under my arm, and went undercover to try to find him.

And I did ! So today for a special episode I, Rémi Louf, will be the one asking questions and making bad jokes with a French accent.

Before letting him in, here’s what I got on him so far.

By day, Alex is a Bayesian modeler at the PyMC Labs consultancy. By night, he doesn’t (yet) fight crime but he’s an open-source enthusiast and core contributor to PyMC and ArviZ.

An always-learning statistician, Alex loves building models and studying elections and human behavior.

When he’s not working, he loves hiking, exercising, meditating and reading nerdy books and novels. He also loves chocolate a bit too much, but he doesn’t like talking about it – he prefers eating it.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland and Aubrey Clayton.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Alex on Twitter: https://twitter.com/alex_andorra
• Alex on GitHub: https://github.com/AlexAndorra
• Alex on LinkedIn: https://www.linkedin.com/in/aandorra-pollsposition/
• Intuitive Bayes Introductory Course:

Wait, that doesn’t sound right, does it? Our brain is a huge causal machine, so it can instinctively feel it’s not credible that size of truck and amount of damage done are causally related: there must be another variable explaining the correlation. Here, it’s of course the seriousness of the fire — even better, it’s the common cause of the two correlated variables.

Your brain does that automatically, but what about your computer? How do you make sure it doesn’t just happily (and mistakenly) report the correlation? That’s when causal inference and machine learning enter the stage, as Robert Osazuwa Ness will tell us.

Robert has a PhD in statistics from Purdue University. He currently works as a Research Scientist at Microsoft Research and a founder of altdeep.ai, which teaches live cohort-based courses on advanced topics in applied modeling. 

As you’ll hear, his research focuses on the intersection of causal and probabilistic machine learning. Maybe that’s why I invited him on the show… Well, who knows, causal inference is very hard!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland and Aubrey Clayton.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Robert's webpage: https://www.microsoft.com/en-us/research/people/robertness/
• Robert on Twitter: https://twitter.com/osazuwa
• Robert on GitHub: https://github.com/robertness
• Robert on LinkedIn: https://www.linkedin.com/in/osazuwa/
• Do-calculus enables causal reasoning with latent variable models, Arxiv: https://arxiv.org/abs/2102.06626
• Integrating Markov processes with structural causal modeling enables counterfactual inference in complex systems, NeurIPS...

In this mind-bending episode, Dominique Makowski will for sure expand your horizon. Trained as a clinical neuropsychologist, he is currently working as a postdoc at the Clinical Brain Lab in Singapore, in which he leads the Reality Bending Team. What’s reality-bending you ask? Well, you’ll have to listen to the episode, but I can already tell you we’ll go through a journey in scientific methodology, history of art, religion, and philosophy — what else?

Beyond that, Dominique tries to improve the access to advanced analysis techniques by developing open-source software and tools, like the NeuroKit Python package or the bayestestR package in R.

Even better, he looks a lot like his figures of reference. Like Marcus Aurelius, he plays the piano and guitar. Like Sisyphus, he loves history of art and comparative mythology. And like Yoda, he is a wakeboard master.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Aaron Jones, Daniel Lindroth, Yoshiyuki Hamajima, Sven De Maeyer and Michael DeCrescenzo.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• To follow:
• Dominique's website: https://dominiquemakowski.github.io/
• Dominique on Twitter: https://twitter.com/Dom_Makowski
• Dominique on GitHub: https://github.com/DominiqueMakowski
• Packages:
• NeuroKit -- Python Toolbox for Neurophysiological Signal Processing: https://github.com/neuropsychology/NeuroKit
• bayestestR -- Become a Bayesian master you will: https://easystats.github.io/bayestestR/
• report -- From R to your manuscript: https://easystats.github.io/report/
• Research:
• The Reality Bending...

To celebrate that random, crazy adventure, I wanted to do a special episode at any random point, and so it looks like it’s gonna be #50! This episode is special by its guest, not its number — although my guest knows a thing or two about numbers. Most recently, he wrote the book Covid by Numbers.

A mathematical statistician dedicated to helping the general public understand risk, uncertainty and decision-making, he’s the author of several books on the topic actually, including The Art of Statistics. You may also know him from his podcast, Risky Talk, or his numerous appearances in newspapers, radio and TV shows.

Did you guess who it is?

Maybe you just know him as the reigning World Champion in Loop – a version of pool played on an elliptical table – and are just discovering now that he is a fantastic science communicator – something that turns out to be especially important for stats education in times of, let’s say, global pandemic for instance.

He holds a PhD in Mathematical Statistics from the University of London and has been the Chair of the Winton Centre for Risk and Evidence Communication at Cambridge University since 2016. He was also the President of the famous Royal Statistical Society in 2017-2018.

Most importantly, he was featured in BBC1’s Winter Wipeout in 2011 – seriously, go check it out on his website; it’s hilarious.

So did you guess it yet? Yep, my guest for this episode is no other than Sir David Spiegelhalter — yes, there are Bayesian knights!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Matthew McAnear, Michael Hankin, Cameron Smith, Luis Iberico, Alejandro Morales and Tomáš Frýda.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• David's website: http://www.statslab.cam.ac.uk/~david/
• David on Twitter: https://twitter.com/d_spiegel
• The Art of Statistics: https://dspiegel29.github.io/ArtofStatistics/
• Risky Talk podcast: https://riskytalk.libsyn.com/
• Winton Centre for Risk and Evidence Communication:

But rest assured, we talked about intent to treat and randomization, proportional odds, clinical trial design, bio stats and covid19, and even which mistakes you should do to learn Bayes stats — yes, you heard right, which mistakes. Anyway, I can’t tell you everything here — you’ll just have to listen to the episode!

A long time Bayesian, Frank is a Professor of Biostatistics in the School of Medicine at Vanderbilt University. His numerous research interests include predictive models and model validation, Bayesian clinical trial design and Bayesian models, drug development, and clinical research.

He holds a PhD in biostatistics from the University of North Carolina, and did his Bachelor in mathematics at the University of Alabama in Birmingham.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin and Philippe Labonde.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Frank's website and courses: https://hbiostat.org/
• Frank's blog: https://www.fharrell.com/
• Frank on Twitter: https://twitter.com/f2harrell
• COVID-19 Randomized Clinical Trial Design: https://hbiostat.org/proj/covid19/
• Frank on GitHub: https://github.com/harrelfe
• Regression Modeling Strategies repository: https://github.com/harrelfe/rms
• Biostatistics for Biomedical Research repository: https://github.com/harrelfe/bbr
• Bayesian Approaches to Randomized Trials, Spiegelhalter et al.: http://hbiostat.org/papers/Bayes/spi94bay.pdf
• Statistical Rethinking, Richard...

Get 20% off until December 31st with promo code GOODBAYESIAN21

We often talk about applying Bayesian statistics on this podcast. But how do we teach them? What’s the best way to introduce them from a young age and make sure the skills students learn in the stats class are transferable?

Well, lucky us, Mine Dogucu’s research tackles precisely those topics!

An Assistant Professor of Teaching in the Department of Statistics at University of California Irvine, Mine is both an educator with an interest in statistics, and an applied statistician with experience in educational research.

Her work focuses on modern pedagogical approaches in the statistics curriculum, making data science education more accessible. In particular, she teaches an undergraduate Bayesian course, and is the coauthor of the upcoming book Bayes Rules! An Introduction to Bayesian Modeling with R.

In other words, Mine is not only interested in teaching, but also in how best to teach statistics – how to engage students in remote classes, how to get to know them, how to best record and edit remote courses, etc. She writes about these topics on her blog, DataPedagogy.com.

She also works on accessibility and inclusion, as well as a study that investigates how popular Bayesian courses are at the undergraduate level in the US — that should be fun to talk about!

Mine did her Master’s at Bogazici University in Istanbul, Turkey, and then her PhD in Quantitative Research, Evaluation, and Measurement at Ohio State University.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, John Johnson, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode and Patrick Kelley.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Mine's website: https://mdogucu.ics.uci.edu/index.html
• Mine's blog: https://www.datapedagogy.com/
• Mine on Twitter: https://twitter.com/MineDogucu
• Mine on GitHub: https://github.com/mdogucu
• Bayes Rules! An Introduction to Bayesian Modeling with R: https://www.bayesrulesbook.com/
• R package for Supplemental Materials for the Bayes Rules! Book:

Quan is a PhD student in computer science at Washington University in St Louis, USA, researching Bayesian machine learning and one of the PyMCon program committee chairs. He is also the author of several programming books on Python and scientific computing.

Ravin is a core contributor to Arviz and PyMC, and is leading the PyMCon conference. He holds a Bachelors in Mechanical Engineering and a Masters in Manufacturing Engineering. As a Principal Data Scientist he has used Bayesian Statistics to characterize and aid decision making at organizations like SpaceX and Sweetgreen. Ravin is also currently co-authoring a book with Ari Hartikainen, Osvaldo Martin, and Junpeng Lao on Bayesian Statistics due for release in February.

We talked about why they became involved in the conference, parsed through the numerous, amazing talks that are planned, and detailed who the keynote speakers will be… So, If you’re interested the link to register is in the show notes, and there are even two ways to get a free ticket: either by applying to a diversity scholarship, or by being a community partner, which is anyone or any organization working towards diversity and inclusion in tech — all links are in the show notes.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• PyMCon speakers: https://pymc-devs.github.io/pymcon/speakers
• Register to PyMCon: https://www.eventbrite.com/e/pymcon-2020-tickets-121404065829
• PyMCon Diversity Scholarship: https://bit.ly/2J3Vb9d
• PyMCon Community Partner Form: https://bit.ly/35yq90L
• PyMC3 -- Probabilistic Programming in Python: https://docs.pymc.io
• Donate to PyMC3: https://numfocus.org/donate-to-pymc3
• PyMC3 for enterprise: https://bit.ly/3jo9jq9
• Ravin on Twitter: https://twitter.com/canyon289
• Quan on the web: https://krisnguyen135.github.io/
• Quan's author page: https://amzn.to/37JsB7r
• Alex talks about polls on the "Local Maximum" podcast: https://bit.ly/3e1Ro7O
• Support "Learning Bayesian Statistics" on Patreon: https://www.patreon.com/learnbayesstats

Thank you to my Patrons for making...

Elea is an Assistant Professor of Marketing at Drexel, and in this episode she’ll tell us which methods are the most useful in marketing analytics, and why.

Indeed, Elea develops data analysis methods to inform marketing decisions, such as designing new products and planning advertising campaigns. Often faced with missing, unmatched or aggregated data, she uses MCMC sampling, hierarchical models and decision theory to decipher all this.

After an MS in Industrial Engineering at Lehigh University and a PhD in Marketing at the University of Michigan, Elea worked on product design at General Motors and was most recently the Executive Director of the Wharton Customer Analytics Initiative.

Thanks to all these experiences, Elea loves teaching marketing analytics and Bayesian and causal inference at all levels. She even wrote the book R for Marketing Research and Analytics with Chris Chapman, at Springer Press.

In summary, I think you’ll be pretty surprised by how Bayesian the world of marketing is…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Elea's website: http://eleafeit.com/
• R for Marketing Research and Analytics: http://r-marketing.r-forge.r-project.org/
• Elea's Tutorials & Online Courses: http://eleafeit.com/teaching/
• Elea on Twitter: https://twitter.com/eleafeit
• Elea on GitHub: https://github.com/eleafeit
• Tutorial on Conjoint Analysis in R: https://github.com/ksvanhorn/ART-Forum-2017-Stan-Tutorial
• Test & Roll app: https://testandroll.shinyapps.io/testandroll/
• Test & Roll Paper -- Profit-Maximizing A/B Tests: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3274875
• Principal Stratification for Advertising Experiments: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3140631
• CausalImpact R package: https://google.github.io/CausalImpact/CausalImpact.html
• Chapter on Data Fusion in marketing: https://link.springer.com/referenceworkentry/10.1007/978-3-319-05542-8_9-1
• Statistical Analysis with Missing Data (Little & Rubin): https://onlinelibrary.wiley.com/doi/book/10.1002/9781119013563
• R-Ladies Philly YouTube channel:

Elizaveta Semenova will tell you why in this episode, by walking us through the case study she recently wrote with the Stan team. She’ll also tell us how she used Gaussian Processes on spatio-temporal data, to study the spread of Malaria, or to fit dose-response curves in pharmaceutical tests. 

And finally, she’ll tell us how she used Bayesian neural networks for drug toxicity prediction in her latest paper, and how Bayesian neural nets behave compared to classical neural nets. Ow, and you’ll also learn an interesting link between BNNs and Gaussian Processes…

I know: Liza works on _a lot_ of projects! But who is she? Well, she’s a postdoctorate in Bayesian Machine Learning at the pharmaceutical company AstraZeneca, in Cambridge, UK. 

Elizaveta did her masters in theoretical mathematics in Moscow, Russia, and then worked in financial services as an actuary in various European countries. She then did a PhD in epidemiology at the University of Basel, Switzerland. This is where she got interested in health applications – be it epidemiology, global health or more small-scale biological questions. But she’ll tell you all that in the episode ;)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Liza on Twitter: https://twitter.com/liza_p_semenova
• Liza on GitHub: https://github.com/elizavetasemenova
• Liza's blog: https://elizavetasemenova.github.io/blog/
• A Bayesian neural network for toxicity prediction: https://www.biorxiv.org/content/10.1101/2020.04.28.065532v2
• Bayesian Neural Networks for toxicity prediction -- Video presentation: https://www.youtube.com/watch?v=BCQ2oVlu_tY&t=751s
• Bayesian workflow for disease transmission modeling in Stan: https://mc-stan.org/users/documentation/case-studies/boarding_school_case_study.html
• Andrew Gelman's comments on the SIR case-study: https://statmodeling.stat.columbia.edu/2020/06/02/this-ones-important-bayesian-workflow-for-disease-transmission-modeling-in-stan/
• Determining organ weight toxicity with Bayesian causal models: https://www.biorxiv.org/content/10.1101/754853v1
• Material for Applied Machine Learning Days ("Embracing uncertainty"): https://github.com/elizavetasemenova/EmbracingUncertainty
• Predicting Drug-Induced Liver Injury with Bayesian Machine Learning: https://pubs.acs.org/doi/abs/10.1021/acs.chemrestox.9b00264
• Ordered Logistic Regression in Stan, PyMC3 and Turing: https://medium.com/@liza_p_semenova/ordered-logistic-regression-and-probabilistic-programming-502d8235ad3f
• PyMCon website: https://pymc-devs.github.io/pymcon/
• PyMCon Call For Proposal: https://pymc-devs.github.io/pymcon/cfp
• PyMCon...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire, Mike Loncaric, David McCormick, Ronald Legere, Sergio Dolia, Michael Cao, Yiğit Aşık and Suyog Chandramouli.

Takeaways:

• Player tracking data revolutionized sports analytics.
• Decision-making in sports involves managing uncertainty and budget constraints.
• Luke emphasizes the importance of portfolio optimization in team management.
• Clubs with high budgets can afford inefficiencies in player acquisition.
• Statistical methods provide a probabilistic approach to player value.
• Removing human bias is crucial in sports decision-making.
• Understanding player performance distributions aids in contract decisions.
• The goal is to maximize performance value per dollar spent.
• Model validation in sports requires focusing on edge cases.

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Designing experiments is about optimal data gathering.
• The optimal design maximizes the amount of information.
• The best experiment reduces uncertainty the most.
• Computational challenges limit the feasibility of BED in practice.
• Amortized Bayesian inference can speed up computations.
• A good underlying model is crucial for effective BED.
• Adaptive experiments are more complex than static ones.
• The future of BED is promising with advancements in AI.

Chapters:

00:00 Introduction to Bayesian Experimental Design

07:51 Understanding Bayesian Experimental Design

19:58 Computational Challenges in Bayesian Experimental Design

28:47 Innovations in Bayesian Experimental Design

40:43 Practical Applications of Bayesian Experimental Design

52:12 Future of Bayesian Experimental Design

01:01:17 Real-World Applications and Impact

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov,...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

In this episode, I am honored to talk with a legend of sports analytics in general, and baseball analytics in particular. I am of course talking about Jim Albert.

Jim grew up in the Philadelphia area and studied statistics at Purdue University. He then spent his entire 41-year academic career at Bowling Green State University, which gave him a wide diversity of classes to teach – from intro statistics through doctoral level.

As you’ll hear, he’s always had a passion for Bayesian education, Bayesian modeling and learning about statistics through sports. I find that passion fascinating about Jim, and I suspect that’s one of the main reasons for his prolific career — really, the list of his writings and teachings is impressive; just go take a look at the show notes.

Now an Emeritus Professor of Bowling Green, Jim is retired, but still an active tennis player and writer on sports analytics — his blog, “Exploring Baseball with R”, is nearing 400 posts!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony and Joshua Meehl.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Jim’s website: https://bayesball.github.io/
• Jim’s baseball blog: https://baseballwithr.wordpress.com/
• Jim on...

Matt Hoffman has already worked on many topics in his life – music information retrieval, speech enhancement, user behavior modeling, social network analysis, astronomy, you name it.

Obviously, picking questions for him was hard, so we ended up talking more or less freely — which is one of my favorite types of episodes, to be honest.

You’ll hear about the circumstances Matt would advise picking up Bayesian stats, generalized HMC, blocked samplers, why do the samplers he works on have food-based names, etc.

In case you don’t know him, Matt is a research scientist at Google. Before that, he did a postdoc in the Columbia Stats department, working with Andrew Gelman, and a Ph.D at Princeton, working with David Blei and Perry Cook.

Matt is probably best known for his work in approximate Bayesian inference algorithms, such as stochastic variational inference and the no-U-turn sampler, but he’s also worked on a wide range of applications, and contributed to software such as Stan and TensorFlow Probability.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Trey Causey, Andreas Kröpelin, Raphaël R, Nicolas Rode and Gabriel Stechschulte.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Matt’s website: http://matthewdhoffman.com/
• Matt on Google Scholar: https://scholar.google.com/citations?hl=en&user=IeHKeGYAAAAJ&view_op=list_works
• The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo: https://www.jmlr.org/papers/volume15/hoffman14a/hoffman14a.pdf
• Tuning-Free Generalized Hamiltonian Monte Carlo:

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Matt emphasizes the importance of Bayesian statistics in scenarios with limited data.
• Communicating insights to coaches is a crucial skill for data analysts.
• Building a data team requires understanding the needs of the coaching staff.
• Player recruitment is a significant focus in football analytics.
• The integration of data science in sports is still evolving.
• Effective data modeling must consider the practical application in games.
• Collaboration between data analysts and coaches enhances decision-making.
• Having a robust data infrastructure is essential for efficient analysis.
• The landscape of sports analytics is becoming increasingly competitive. 
• Player recruitment involves analyzing various data models.
• Biases in traditional football statistics can skew player evaluations.
• Statistical techniques should leverage the structure of football data.
• Tracking data opens new avenues for understanding player movements.
• The role of data analysis in football will continue to grow.
• Aspiring analysts should focus on curiosity and practical experience.

Chapters:

00:00 Introduction to Football Analytics and Matt's Journey

04:54 The Role of Bayesian Methods in Football

10:20 Challenges in Communicating Data Insights

17:03 Building Relationships with Coaches

22:09 The Structure of the Data Team at Como

26:18 Focus on Player Recruitment and Transfer Strategies

28:48 January Transfer Window Insights

30:54 Biases in Football Data Analysis

34:11 Comparative Analysis of Men's and Women's Football

36:55 Statistical Techniques in Football Analysis

42:48 The Impact of Tracking Data on Football Analysis

45:49 The Future of Data-Driven Football Strategies

47:27 Advice for Aspiring Football Analysts

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/99-exploring-quantum-physics-bayesian-stats-chris-ferrie/

Watch the interview: https://www.youtube.com/watch?v=pRaT6FLF7A8

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Indeed, Chelsea’s research focuses on using statistics and machine learning on behavioral data, but her more general goal is to empower people to be able to do their own statistical analyses, through consulting, education, and, as you may have seen, stats memes on Twitter.

A full-time teacher, researcher and statistical consultant, Chelsea earned an MsC and PhD in Computational and Data Science in 2021 from Chapman University. Her courses include R, intro to programming (in Python), and data science.

In a nutshell, Chelsea is, by her own admission, an avid lover of anything silly or statistical. Hopefully, this episode turned out to be both at once! I’ll let you be the judge of that…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin and Philippe Labonde.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Chelsea's website: https://cmparlettpelleriti.github.io/index.html
• Chelsea on Twitter: https://twitter.com/ChelseaParlett
• Michael Betancourt's sparsity case study: https://betanalpha.github.io/assets/case_studies/modeling_sparsity.html
• LBS #31 -- Bayesian Cognitive Modeling & Decision-Making, with Michael Lee: https://www.learnbayesstats.com/episode/31-bayesian-cognitive-modeling-michael-lee
• Projection predictive variable selection R package: https://mc-stan.org/projpred/
• SelectiveInference R package: https://cran.r-project.org/web/packages/selectiveInference/selectiveInference.pdf
• Statistical learning and selective inference: https://www.pnas.org/content/112/25/7629
• LBS #29 -- Model Assessment, Non-Parametric Models, with Aki Vehtari:

To talk about that, I invited Kevin Minkus on the show — he’s a data scientist and soccer fan living in Philadelphia. Kevin’s currently working at Monetate on ecommerce problems, and prior to Monetate he worked on property and casualty insurance pricing.

He spends a lot of his spare time working on problems in football analytics and is a contributor at American Soccer Analysis, a website and podcast dedicated to… football made or played in the US (or “soccer”, as they say over there). Kevin is responsible for some of their data management and devops, and he recently wrote a guide to football analytics for the Major League Soccer’s website, entitled « Soccer Analytics 101 ».

To be honest, I had a great time talking for one hour about two of my passions — football and stats! Soooo, maybe 2020 isn’t that bad after all… Ow, and beyond football, Kevin is also into the digital humanities, web development, 3D animation, machine learning, and… the bassoon!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Kevin on Twitter: https://twitter.com/kevinminkus
• Kevin on GitHub: https://github.com/kcm30
• Soccer Analytics 101: https://www.mlssoccer.com/soccer-analytics-guide/2020/soccer-analytics-101
• American Soccer Analysis: https://www.americansocceranalysis.com/

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran and Paul Oreto.

And in a sense, this whole podcast is dedicated to sampling the whole distribution of Bayesian practitioners. So, for this episode, I thought we’d take a break of pure, hard modeling and talk about how to get involved into Bayesian statistics and open-source development, how companies use Bayesian tools, and what common struggles and misperceptions the latter suffer from.

Quite the program, right? The good news is that Peadar Coyle, my guest for this episode, has done all of that! Coming to us from Armagh, Ireland, Peadar is a fellow PyMC core developer and was a data science and data engineer consultant until recently – a period during which he has covered all of modern startup data science, from AB testing to dashboards to data engineering to putting models into production.

From these experiences, Peadar has written a book consisting of numerous interviews with data scientists throughout the world – and do consider buying it, as money goes to the NumFOCUS organization, under which many Bayesian stats packages live, like Stan, ArviZ, PyMC, etc.

Now living in London, Peadar recently founded the start-up Aflorithmic, an AI solution that aims at developing personalized voice-first solutions for brands and enterprises. Their technology is also used to support children, families and elderly coping with the mental health challenges of COVID-19 confinements.

Before all that, Peadar studied physics, philosophy and mathematics at the universities of Bristol and Luxembourg. When he’s away from keyboard, he enjoys the outdoors, cooking and, of course, watching rugby!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll and Nathaniel Burbank.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• "Matchmaking Dinner" announcement: https://twitter.com/alex_andorra/status/1351136756087734272
• How to get acces to "Matchmaking Dinner" episodes: https://www.patreon.com/learnbayesstats
• Peadar on Twitter: https://twitter.com/springcoil
• Peadar's website: https://peadarcoyle.com/
• Peadar on GitHub: https://github.com/springcoil
• Interviews with Data Scientists -- A discussion of the Industy and the current trends:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• User experience is crucial for the adoption of Stan.
• Recent innovations include adding tuples to the Stan language, new features and improved error messages.
• Tuples allow for more efficient data handling in Stan.
• Beginners often struggle with the compiled nature of Stan.
• Improving error messages is crucial for user experience.
• BridgeStan allows for integration with other programming languages and makes it very easy for people to use Stan models.
• Community engagement is vital for the development of Stan.
• New samplers are being developed to enhance performance.
• The future of Stan includes more user-friendly features.

Chapters:

00:00 Introduction to the Live Episode

02:55 Meet the Stan Core Developers

05:47 Brian Ward's Journey into Bayesian Statistics

09:10 Charles Margossian's Contributions to Stan

11:49 Recent Projects and Innovations in Stan

15:07 User-Friendly Features and Enhancements

18:11 Understanding Tuples and Their Importance

21:06 Challenges for Beginners in Stan

24:08 Pedagogical Approaches to Bayesian Statistics

30:54 Optimizing Monte Carlo Estimators

32:24 Reimagining Stan's Structure

34:21 The Promise of Automatic Reparameterization

35:49 Exploring BridgeStan

40:29 The Future of Samplers in Stan

43:45 Evaluating New Algorithms

47:01 Specific Algorithms for Unique Problems

50:00 Understanding Model Performance

54:21 The Impact of Stan on Bayesian Research

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

In this episode, Andy Aschwanden and Doug Brinkerhoff tell us about their work in glaciology and the application of Bayesian statistics in studying glaciers. They discuss the use of computer models and data analysis in understanding glacier behavior and predicting sea level rise, and a lot of other fascinating topics.

Andy grew up in the Swiss Alps, and studied Earth Sciences, with a focus on atmospheric and climate science and glaciology. After his PhD, Andy moved to Fairbanks, Alaska, and became involved with the Parallel Ice Sheet Model, the first open-source and openly-developed ice sheet model.

His first PhD student was no other than… Doug Brinkerhoff! Doug did an MS in computer science at the University of Montana, focusing on numerical methods for ice sheet modeling, and then moved to Fairbanks to complete his PhD. While in Fairbanks, he became an ardent Bayesian after “seeing that uncertainty needs to be embraced rather than ignored”. Doug has since moved back to Montana, becoming faculty in the University of Montana’s computer science department.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero and Will Geary.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/101-black-holes-collisions-gravitational-waves-ligo-experts-christopher-berry-john-veitch/

Watch the interview: https://www.youtube.com/watch?v=ZaZwCcrJlik

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

In this episode, we dive deep into gravitational wave astronomy, with Christopher Berry and John Veitch, two senior lecturers at the University of Glasgow and experts from the LIGO-VIRGO collaboration. They explain the significance of detecting gravitational waves, which are essential for understanding black holes and neutron stars collisions. This research not only sheds light on these distant events but also helps us grasp the fundamental workings of the universe.

Our discussion focuses on the integral role of Bayesian statistics, detailing how they use nested sampling for extracting crucial information from the subtle signals of gravitational waves. This approach is vital for parameter estimation and understanding the distribution of cosmic sources through population inferences.

Concluding the episode, Christopher and John highlight the latest advancements in black hole astrophysics and tests of general relativity, and touch upon the exciting prospects and challenges of the upcoming space-based LISA mission.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

 ⁃    Gravitational wave analysis involves using Bayesian statistics for parameter estimation and population...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/100-reactive-message-passing-automated-inference-in-julia-dmitry-bagaev/

Watch the interview: https://www.youtube.com/watch?v=ZG3H0xxCXTQ

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/99-exploring-quantum-physics-bayesian-stats-chris-ferrie/

Watch the interview: https://www.youtube.com/watch?v=pRaT6FLF7A8

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/98-fusing-statistical-physics-machine-learning-adaptive-mcmc-marylou-gabrie/

Watch the interview: https://www.youtube.com/watch?v=vVqZ0WWXX7g

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie and Cory Kiser.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• State space models and traditional time series models are well-suited to forecast loss ratios in the insurance industry, although actuaries have been slow to adopt modern statistical methods.
• Working with limited data is a challenge, but informed priors and hierarchical models can help improve the modeling process.
• Bayesian model stacking allows for blending together different model predictions and taking the best of both (or all if more than 2 models) worlds.
• Model comparison is done using out-of-sample performance metrics, such as the expected log point-wise predictive density (ELPD). Brute leave-future-out cross-validation is often used due to the time-series nature of the data.
• Stacking or averaging models are trained on out-of-sample performance metrics to determine the weights for blending the predictions. Model stacking can be a powerful approach for combining predictions from candidate models. Hierarchical stacking in particular is useful when weights are assumed to vary according to covariates.
• BayesBlend is a Python package developed by Ledger Investing that simplifies the implementation of stacking models, including pseudo Bayesian model averaging, stacking, and hierarchical stacking.
• Evaluating the performance of patient time series models requires considering multiple metrics, including log likelihood-based metrics like ELPD, as well as more absolute metrics like RMSE and mean absolute error.
• Using robust variants of metrics like ELPD can help address issues with extreme outliers. For example, t-distribution estimators of ELPD as opposed to sample sum/mean estimators.
• It is important to evaluate model performance from different perspectives and consider the trade-offs between different metrics. Evaluating models based solely on traditional metrics can limit understanding and trust in the model. Consider additional factors such as interpretability, maintainability, and productionization.
• Simulation-based calibration (SBC) is a valuable tool for assessing parameter estimation and model correctness. It allows for the interpretation of model parameters and the identification of coding errors.
• In industries like insurance, where regulations may restrict model choices, classical statistical approaches still play a significant role. However, there is potential for Bayesian methods and generative AI in certain areas.

For the first episode of the kind, I had the chance to chat with Michael Kennedy! Michael is not only a very knowledgeable and respected member of the Python community, he’s also the founder and host of Talk Python To Me, the most popular Python podcast. He’s the founder and chief author at Talk Python Training, where he develops many Python developer online courses. 

And before that, Michael was a professional software trainer for over 10 years – he has taught numerous developers throughout the world! But Michael is not only an entrepreneur and teacher – he’s also a father, a husband, and a proud inhabitant of Portland, OR! 

As you’ll hear, our conversation spanned a large array of topics — the role of Python in science and research; how it came to be so important in data science, and why; what are Python’s threats and weaknesses and how it should evolve to not become obsolete. Michael also has interesting thoughts on the role of programming in education and how it relates to geometry — but I’ll let you discover that one by yourself…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Michael on Twitter: https://twitter.com/mkennedy
• The Talk Python Podcast: https://talkpython.fm/
• The Python Bytes Podcast: https://pythonbytes.fm/
• Michael's blog: https://blog.michaelckennedy.net/
• Michael on Crowdcast: https://www.crowdcast.io/mkennedy
• Jupytext -- Turn Jupyter Notebooks to scripts and (R) Markdown files: https://jupytext.readthedocs.io/en/latest/introduction.html

Vianey Leos Barajas is indeed a statistician primarily working in the areas of statistical ecology, time series modeling, Bayesian inference and spatial modeling of environmental data. Vianey did her PhD in statistics at Iowa State University and is now a postdoctoral researcher at North Carolina State University.

In this episode, she’ll tell us what she’s working on that involves sharks, sheep and other animals! Trying to model animal movements, Vianey often encounters the dreaded multimodal posteriors. She’ll explain why these can be very tricky to estimate, and why ecological data are particularly suited for hidden Markov models and spatio-temporal models — don’t worry, Vianey will explain what these models are in the episode!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Vianey on Twitter: https://twitter.com/vianey_lb
• Hidden Markov Models in the Stan User's Guide: https://mc-stan.org/docs/2_18/stan-users-guide/hmms-section.html
• Tagging Basketball Events with HMM in Stan: https://mc-stan.org/users/documentation/case-studies/bball-hmm.html
• HMMs with Python and PyMC3: https://ericmjl.github.io/bayesian-analysis-recipes/notebooks/markov-models/
• The Discrete Adjoint Method -- Efficient Derivatives for Functions of Discrete Sequences (Betancourt, Margossian, Leos-Barajas): https://arxiv.org/abs/2002.00326
• Vianey will be doing an HMM 90-minute introduction at the International Statistical Ecology Conference in June 2020: http://www.isec2020.org/
• Stan for Ecology -- a website for the ecology community in Stan: https://stanecology.github.io/
• LatinR 2020 -- 7th to 9th October 2020: https://latin-r.com/
• Migramar -- Science for the Conservation of Marine Migratory Species in the Eastern Pacific: http://migramar.org/hi/en/
• Pelagios Kakunja -- Know, educate and conserve for a sustainable sea: https://www.pelagioskakunja.org/

Book recommendations:

• Hidden Markov Models for Time Series: https://www.routledge.com/Hidden-Markov-Models-for-Time-Series-An-Introduction-Using-R-Second-Edition/Zucchini-MacDonald-Langrock/p/book/9781482253832
• Handbook of Mixture Analysis:

• Get early access to Alex's next live-cohort courses!
• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• BART as a core tool: Gabriel explains how Bayesian Additive Regression Trees provide robust uncertainty quantification and serve as a reliable baseline model in many domains.
• Rust for performance: His Rust re-implementation of BART dramatically improves speed and scalability, making it feasible for larger datasets and real-world IoT applications.
• Strengths and trade-offs: BART avoids overfitting and handles missing data gracefully, though it is slower than other tree-based approaches.
• Big data meets Bayes: Gabriel shares strategies for applying Bayesian methods with big data, including when variational inference helps balance scale with rigor.
• Optimization and decision-making: He highlights how BART models can be embedded into optimization frameworks, opening doors for sequential decision-making.
• Open source matters: Gabriel emphasizes the importance of communities like PyMC and Bambi, encouraging newcomers to start with small contributions.

Chapters:

05:10 – From economics to IoT and Bayesian statistics

18:55 – Introduction to BART (Bayesian Additive Regression Trees)

24:40 – Re-implementing BART in Rust for speed and scalability

32:05 – Comparing BART with Gaussian Processes and other tree methods

39:50 – Strengths and limitations of BART

47:15 – Handling missing data and different likelihoods

54:30 – Variational inference and big data challenges

01:01:10 – Embedding BART into optimization and decision-making frameworks

01:08:45 – Open source, PyMC, and community support

01:15:20 – Advice for newcomers

01:20:55 – Future of BART, Rust, and probabilistic programming

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• DADVI is a new approach to variational inference that aims to improve speed and accuracy.
• DADVI allows for faster Bayesian inference without sacrificing model flexibility.
• Linear response can help recover covariance estimates from mean estimates.
• DADVI performs well in mixed models and hierarchical structures.
• Normalizing flows present an interesting avenue for enhancing variational inference.
• DADVI can handle large datasets effectively, improving predictive performance.
• Future enhancements for DADVI may include GPU support and linear response integration.

Chapters:

13:17 Understanding DADVI: A New Approach

21:54 Mean Field Variational Inference Explained

26:38 Linear Response and Covariance Estimation

31:21 Deterministic vs Stochastic Optimization in DADVI

35:00 Understanding DADVI and Its Optimization Landscape

37:59 Theoretical Insights and Practical Applications of DADVI

42:12 Comparative Performance of DADVI in Real Applications

45:03 Challenges and Effectiveness of DADVI in Various Models

48:51 Exploring Future Directions for Variational Inference

53:04 Final Thoughts and Advice for Practitioners

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Aubrey Clayton, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël...

Alex and Martin discuss the intricacies of variational inference, particularly focusing on the ADVI method and its challenges. They explore the evolution of approximate inference methods, the significance of mean field variational inference, and the innovative linear response technique for covariance estimation.

The discussion also delves into the trade-offs between stochastic and deterministic optimization techniques, providing insights into their implications for Bayesian statistics.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Alex and Ethan discuss the application of Bayesian inference in high energy density physics, particularly in analyzing complex data sets. They highlight the advantages of Bayesian techniques, such as incorporating prior knowledge and managing uncertainties.

They also shares insights from an ongoing experimental project focused on measuring the equation of state of plasma at extreme pressures. Finally, Alex and Ethan advocate for best practices in managing large codebases and ensuring model reliability.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Setting appropriate priors is crucial to avoid overfitting in models.
• R-squared can be used effectively in Bayesian frameworks for model evaluation.
• Dynamic regression can incorporate time-varying coefficients to capture changing relationships.
• Predictively consistent priors enhance model interpretability and performance.
• Identifiability is a challenge in time series models.
• State space models provide structure compared to Gaussian processes.
• Priors influence the model's ability to explain variance.
• Starting with simple models can reveal interesting dynamics.
• Understanding the relationship between states and variance is key.
• State-space models allow for dynamic analysis of time series data.
• AI can enhance the process of prior elicitation in statistical models.

Chapters:

10:09 Understanding State Space Models

14:53 Predictively Consistent Priors

20:02 Dynamic Regression and AR Models

25:08 Inflation Forecasting

50:49 Understanding Time Series Data and Economic Analysis

57:04 Exploring Dynamic Regression Models

01:05:52 The Role of Priors

01:15:36 Future Trends in Probabilistic Programming

01:20:05 Innovations in Bayesian Model Selection

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki...

Today’s clip is from episode 143 of the podcast, with Christoph Bamberg.

Christoph shares his journey into Bayesian statistics and computational modeling, the challenges faced in academia, and the technical tools used in research.

Alex and Christoph delve into a specific study on appetite regulation and cognitive performance, exploring the implications of framing in psychological research and the importance of careful communication in health-related contexts.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• BoTorch is designed for researchers who want flexibility in Bayesian optimization.
• The integration of BoTorch with PyTorch allows for differentiable programming.
• Scalability at Meta involves careful software engineering practices and testing.
• Open-source contributions enhance the development and community engagement of BoTorch.
• LLMs can help incorporate human knowledge into optimization processes.
• Max emphasizes the importance of clear communication of uncertainty to stakeholders.
• The role of a researcher in industry is often more application-focused than in academia.
• Max's team at Meta works on adaptive experimentation and Bayesian optimization.

Chapters:

08:51 Understanding BoTorch

12:12 Use Cases and Flexibility of BoTorch

15:02 Integration with PyTorch and GPyTorch

17:57 Practical Applications of BoTorch

20:50 Open Source Culture at Meta and BoTorch's Development

43:10 The Power of Open Source Collaboration

47:49 Scalability Challenges at Meta

51:02 Balancing Depth and Breadth in Problem Solving

55:08 Communicating Uncertainty to Stakeholders

01:00:53 Learning from Missteps in Research

01:05:06 Integrating External Contributions into BoTorch

01:08:00 The Future of Optimization with LLMs

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode,...

Proudly sponsored by PyMC Labs, the Bayesian Consultancy. Book a call, or get in touch!

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Teaching students to write out their own models is crucial.
• Developing a sports analytics portfolio is essential for aspiring analysts.
• Modeling expectations in sports analytics can be misleading.
• Tracking data can significantly improve player performance models.
• Ron encourages students to engage in active learning through projects.
• The importance of understanding the dependency structure in data is vital.
• Ron aims to integrate more diverse sports analytics topics into his teaching.

Chapters:

03:51 The Journey into Sports Analytics

15:20 The Evolution of Bayesian Statistics in Sports

26:01 Innovations in NFL WAR Modeling

39:23 Causal Modeling in Sports Analytics

46:29 Defining Replacement Levels in Sports

48:26 The Going Deep Framework and Big Data in Football

52:47 Modeling Expectations in Football Data

55:40 Teaching Statistical Concepts in Sports Analytics

01:01:54 The Importance of Model Building in Education

01:04:46 Statistical Thinking in Sports Analytics

01:10:55 Innovative Research in Player Movement

01:15:47 Exploring Data Needs in American Football

01:18:43 Building a Sports Analytics Portfolio

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell,...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Zero Sum constraints allow for better sampling and estimation in hierarchical models.
• Understanding the difference between population and sample means is crucial.
• A library for zero-sum normal effects would be beneficial.
• Practical solutions can yield decent predictions even with limitations.
• Cholesky parameterization can be adapted for positive correlation matrices.
• Understanding the geometry of sampling spaces is crucial.
• The relationship between eigenvalues and sampling is complex.
• Collaboration and sharing knowledge enhance research outcomes.
• Innovative approaches can simplify complex statistical problems.

Chapters:

03:35 Sean Pinkney's Journey to Bayesian Modeling

11:21 The Zero-Sum Normal Project Explained

18:52 Technical Insights on Zero-Sum Constraints

32:04 Handling New Elements in Bayesian Models

36:19 Understanding Population Parameters and Predictions

49:11 Exploring Flexible Cholesky Parameterization

01:07:23 Closing Thoughts and Future Directions

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Teemu focuses on calibration assessments and predictive checking in Bayesian workflows.
• Simulation-based calibration (SBC) checks model implementation
• SBC involves drawing realizations from prior and generating prior predictive data.
• Visual predictive checking is crucial for assessing model predictions.
• Prior predictive checks should be done before looking at data.
• Posterior SBC focuses on the area of parameter space most relevant to the data.
• Challenges in SBC include inference time.
• Visualizations complement numerical metrics in Bayesian modeling.
• Amortized Bayesian inference benefits from SBC for quick posterior checks. The calibration of Bayesian models is more intuitive than Frequentist models.
• Choosing the right visualization depends on data characteristics.
• Using multiple visualization methods can reveal different insights.
• Visualizations should be viewed as models of the data.
• Goodness of fit tests can enhance visualization accuracy.
• Uncertainty visualization is crucial but often overlooked.

Chapters:

09:53 Understanding Simulation-Based Calibration (SBC)

15:03 Practical Applications of SBC in Bayesian Modeling

22:19 Challenges in Developing Posterior SBC

29:41 The Role of SBC in Amortized Bayesian Inference

33:47 The Importance of Visual Predictive Checking

36:50 Predictive Checking and Model Fitting

38:08 The Importance of Visual Checks

40:54 Choosing Visualization Types

49:06 Visualizations as Models

55:02 Uncertainty Visualization in Bayesian Modeling

01:00:05 Future Trends in Probabilistic Modeling

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire, Mike Loncaric, David McCormick, Ronald Legere, Sergio Dolia, Michael Cao, Yiğit Aşık and Suyog Chandramouli.

Takeaways:

• Epidemiology requires a blend of mathematical and statistical understanding.
• Models are essential for informing public health decisions during epidemics.
• The COVID-19 pandemic highlighted the importance of rapid modeling.
• Misconceptions about data can lead to misunderstandings in public health.
• Effective communication is crucial for conveying complex epidemiological concepts.
• Epidemic thinking can be applied to various fields, including marketing and finance.
• Public health policies should be informed by robust modeling and data analysis.
• Automation can help streamline data analysis in epidemic response.
• Understanding the limitations of models...

Check out Hugo’s latest episode with Fei-Fei Li, on How Human-Centered AI Actually Gets Built

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Computational cognitive science seeks to understand intelligence mathematically.
• Bayesian statistics is crucial for understanding human cognition.
• Inductive biases help explain how humans learn from limited data.
• Eliciting prior distributions can reveal implicit beliefs.
• The wisdom of individuals can provide richer insights than averaging group responses.
• Generative AI can mimic human cognitive processes.
• Human intelligence is shaped by constraints of data, computation, and communication.
• AI systems operate under different constraints than human cognition. Human intelligence differs fundamentally from machine intelligence.
• Generative AI can complement and enhance human learning.
• AI systems currently lack intrinsic human compatibility.
• Language training in AI helps align its understanding with human perspectives.
• Reinforcement learning from human feedback can lead to misalignment of AI goals.
• Representational alignment can improve AI's understanding of human concepts.
• AI can help humans make better decisions by providing relevant information.
• Research should focus on solving problems rather than just methods.

Chapters:

00:00 Understanding Computational Cognitive Science

13:52 Bayesian Models and Human Cognition

29:50 Eliciting Implicit Prior Distributions

38:07 The Relationship Between Human and AI Intelligence

45:15 Aligning Human and Machine Preferences

50:26 Innovations in AI and Human Interaction

55:35 Resource Rationality in Decision Making

01:00:07 Language Learning in AI Models

What happens inside a black hole? Can we travel back in time? Why is the Universe even here? This is the type of chill questions that we’re all asking ourselves from time to time — you know, when we’re sitting on the beach.

This is also the kind of questions Daniel Whiteson loves to talk about in his podcast, “Daniel and Jorge Explain the Universe”, co-hosted with Jorge Cham, the author of PhD comics. Honestly, it’s one of my favorite shows ever, so I warmly recommend it. Actually, if you’ve ever hung out with me in person, there is a high chance I started nerding out about it…

Daniel is, of course, a professor of physics, at the University of California, Irvine, and also a researcher at CERN, using the Large Hadron Collider to search for exotic new particles — yes, these are particles that put little umbrellas in their drinks and taste like coconut.

On his free time, Daniel loves reading, sailing and baking — I can confirm that he makes a killer Nutella roll!

Oh, I almost forgot: Daniel and Jorge wrote two books — We Have No Idea and FAQ about the Universe — which, again, I strongly recommend. They are among my all-time favorites.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, James Ahloy, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bert≈rand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Luis Iberico, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, David Haas, Robert Yolken, Or Duek, Pavel Dusek and Paul Cox.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• PyMC Labs Meetup, Dec 8th 2022, A Candle in the Dark – How to Use Hierarchical Post-Stratification with Noisy Data: https://www.meetup.com/pymc-labs-online-meetup/events/289949398/
• Daniel’s website: https://sites.uci.edu/daniel/
• Daniel on Twitter:

To talk about that, I invited Chad Scherrer. Chad is a Senior Research Scientist at RelationalAI, a company that uses Artificial Intelligence technologies to solve business problems.

Coming from a mathematics background, Chad did his PhD at Indiana University of Bloomington and has been working in statistics and data science for a decade now. Through this experience, he’s been using and developing probabilistic programming languages – so he’s familiar with python, R, PyMC, Stan and all the blockbusters of the field. 

But since 2018, he’s particularly interested in Julia and developed Soss, an open-source lightweight probabilistic programming package for Julia. In this episode, he’ll tell us why he decided to create this package, and which choices he made that made Soss what it is today. But we’ll also talk about other projects in Julia, like Turing or Gen for instance.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Chad's Website: https://cscherrer.github.io/
• Chad on Twitter: https://twitter.com/ChadScherrer
• Soss Package: https://github.com/cscherrer/Soss.jl
• Soss Presentation at 2019 Strata NYC: https://slides.com/cscherrer/2019-09-26-strata#/
• Passage -- A Parallel Sampler Generator for Hierarchical Bayesian Modeling: https://bit.ly/2UTmaYB
• Dynamic HMC in Julia: https://github.com/tpapp/DynamicHMC.jl
• Advanced HMC in Julia: https://github.com/TuringLang/AdvancedHMC.jl
• Monte Carlo Measurements in Julia: https://github.com/baggepinnen/MonteCarloMeasurements.jl
• Turing.jl -- Bayesian inference with probabilistic programming: https://turing.ml/dev/
• Gen.jl -- Probabilistic modeling and inference in Julia: https://www.gen.dev/
• Etalumis -- Bringing Probabilistic Programming to Scientific Simulators at Scale: https://arxiv.org/abs/1907.03382
• Omega.jl -- A programming language for causal and probabilistic reasoning: http://www.zenna.org/Omega.jl/latest/
• JuliaLang -- The Ingredients for a Composable Programming Language: https://white.ucc.asn.au/2020/02/09/whycompositionaljulia.html
• Simpy -- Discrete event simulation for Python:

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Changing perspective is often a great way to solve burning research problems. Riemannian spaces are such a perspective change, as Arto Klami, an Associate Professor of computer science at the University of Helsinki and member of the Finnish Center for Artificial Intelligence, will tell us in this episode.

He explains the concept of Riemannian spaces, their application in inference algorithms, how they can help sampling Bayesian models, and their similarity with normalizing flows, that we discussed in episode 98.

Arto also introduces PreliZ, a tool for prior elicitation, and highlights its benefits in simplifying the process of setting priors, thus improving the accuracy of our models.

When Arto is not solving mathematical equations, you’ll find him cycling, or around a good board game.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

- Riemannian spaces offer a way to improve computational efficiency and accuracy in Bayesian inference by considering the curvature of the posterior distribution.

- Riemannian spaces can be used in Laplace approximation and Markov chain Monte Carlo...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Listen to the full episode: https://learnbayesstats.com/episode/100-reactive-message-passing-automated-inference-in-julia-dmitry-bagaev/

Watch the interview: https://www.youtube.com/watch?v=ZG3H0xxCXTQ

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

This conversation delves into the intricacies of Bayesian deep learning, contrasting it with traditional deep learning and exploring its applications and challenges.

Get the full discussion at https://learnbayesstats.com/episode/129-bayesian-deep-learning-ai-for-science-vincent-fortuin

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

This conversation explores the critical role of patient modeling during the COVID-19 pandemic, highlighting how these models informed public health decisions and the relationship between modeling and policy.

The discussion emphasizes the need for improved communication and understanding of data among the public and policymakers.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Will Kurt is the author of ‘Bayesian Statistics the Fun Way’ and ‘Get Programming With Haskell’. Currently the lead Data Scientist for the pricing and recommendations team at Hopper, he also blogs about stats and probability at countbayesie.com.

In this episode, he’ll tell us how a Boston librarian can become a Data Scientist and work with Bayesian models everyday. He’ll also explain the value of Bayesian inference from a philosophical standpoint, why it’s useful in the travel industry and how his latest book came into life.

Finally, Will is also a big fan of the “mind projection fallacy”, an informal fallacy first described by physicist and Bayesian philosopher Edwin Thompson Jaynes. Does that intrigue you? Well, stay tuned, he’ll tell us more in the episode…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Will's Blog: https://www.countbayesie.com
• Will on Twitter: https://twitter.com/willkurt
• Bayesian Statistics the Fun Way -- Understanding Statistics and Probability with Star Wars, LEGO, and Rubber Ducks: https://nostarch.com/learnbayes
• Get Programming with Haskell: https://www.amazon.com/Get-Programming-Haskell-Will-Kurt/dp/1617293768
• The Mind Projection Fallacy: https://en.wikipedia.org/wiki/Mind_projection_fallacy
• Probability Theory -- The Logic of Science by E.T. Jaynes: https://www.cambridge.org/core/books/probability-theory/9CA08E224FF30123304E6D8935CF1A99
• Wittgenstein's Lectures on the Foundations of Mathematics: https://www.amazon.com/Wittgensteins-Lectures-Foundations-Mathematics-Cambridge/dp/0226904261

In this episode, Colin Carroll will tell us how he did all that in finance and the airline industry. He’ll also share with us what the future of probabilistic programming looks like to him.

You already heard from Colin two weeks ago — so, if you didn’t catch this episode, go back in your feed’s history and enjoy the first part! 

As a reminder, Colin is a machine learning researcher and software engineer who’s notably worked on modeling risk in the airline industry and building NLP-powered search infrastructure for finance. He’s also an active contributor to open source, particularly to the popular PyMC3 and ArviZ libraries.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/!

Links from the show:

•     Colin's blog: https://colindcarroll.com/
•     Gelman’s putting model in PyMC3: https://github.com/pymc-devs/pymc3/blob/master/docs/source/notebooks/putting_workflow.ipynb
•     Matthew Kay’s quantile dotplots: https://github.com/mjskay/when-ish-is-my-bus/blob/master/quantile-dotplots.md
•     Jax, Composable transformations of Python+NumPy programs: https://github.com/google/jax
•     NumPyro, Probabilistic programming with NumPy: https://github.com/pyro-ppl/numpyro
•     Pyro, Deep Universal Probabilistic Programming: https://pyro.ai/
•     Rainier, Bayesian inference in Scala: https://github.com/stripe/rainier

---

Send in a voice message: https://anchor.fm/learn-bayes-stats/message

You probably know that symbols are omnipresent in mathematics — but did you know that they are also very important in statistics, especially probabilistic programming?

Rest assured, I didn’t really know either… until I talked with Brandon Willard! Brandon is indeed a big proponent of relational programming and symbolic computation, and he often promotes their use in research and industry. Actually, a few weeks after our recording, Brandon started spearheading the revival of Theano through the JAX backend that we’re currently working on for the future version of PyMC3!

As you guessed it, Brandon is a core developer of PyMC, and also a contributor to Airflow and IPython, just to name a few. His interests revolve around the means and methods of mathematical modeling and its automation. In a nutshell, he’s a Bayesian statistician: he likes to use the language and logic of probability to quantify uncertainty and frame problems.

After a Bachelor’s in physics and mathematics, Brandon got a Master’s degree in statistics from the University of Chicago. He’s worked in different areas in his career – from finance, transportation and energy to start-ups, gov-tech and academia. Brandon particularly loves projects where popular statistical libraries are inadequate, where sophisticated models must be combined in non-trivial ways, or when you have to deal with high-dimensional and discrete processes.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Vincent Arel-Bundock, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho and Colin Carroll.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Brandon's website: https://brandonwillard.github.io/
• Brandon on GitHub: https://github.com/brandonwillard
• The Future of PyMC3, or "Theano is Dead, Long Live Theano": https://pymc-devs.medium.com/the-future-of-pymc3-or-theano-is-dead-long-live-theano-d8005f8a0e9b
• New Theano-PyMC library: https://github.com/pymc-devs/Theano-PyMC
• Symbolic PyMC: https://pymc-devs.github.io/symbolic-pymc/
• A Role for Symbolic Computation in the General Estimation of Statistical Models:

Thanks to Allison Hilger and Timo Roettger, we’ll discover the world of linguistics, how Bayesian stats are helpful there, and how Paul Bürkner’s BRMS package has been instrumental in this field. To my surprise — and perhaps yours — the speech and language sciences are pretty quantitative and computational!

As she recently discovered Bayesian stats, Allison will also tell us about the challenges she’s faced from advisors and reviewers during her PhD at Northwestern University, and the advice she’d have for people in the same situation.

Allison is now an Assistant Professor at the University of Colorado Boulder. The overall goal in her research is to improve our understanding of motor speech control processes, in order to inform effective speech therapy treatments for improved speech naturalness and intelligibility. Allison also worked clinically as a speech-language pathologist in Chicago for a year. As a new Colorado resident, her new hobbies include hiking, skiing, and biking — and then reading or going to dog parks when she’s to tired.

Holding a PhD in linguistics from the University of Cologne, Germany, Timo is an Associate Professor for linguistics at the University of Oslo, Norway. Timo tries to understand how people communicate their intentions using speech – how are speech signals retrieved; how do people learn and generalize? Timo is also committed to improving methodologies across the language sciences in light of the replication crisis, with a strong emphasis on open science.

Most importantly, Timo loves hiking, watching movies or, even better, watching people play video games!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Brian Huey, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, Adam Bartonicek, William Benton, Alan O'Donnell, Mark Ormsby, Demetri Pananos, James Ahloy, Jon Berezowski, Robin Taylor, Thomas Wiecki, Chad Scherrer, Nathaniel Neitzke, Zwelithini Tunyiswa, Elea McDonnell Feit, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Joshua Duncan, Ian Moran, Paul Oreto, Colin Caprani, George Ho, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Jonathan Sedar, Hugo Botha, Vinh Nguyen, Raul Maldonado, Marcin Elantkowski, Tim Radtke, Adam C. Smith, Will Kurt and Andrew Moskowitz.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Links from the show:

• Allison's website: https://allisonhilger.com/
• Allison on Twitter: https://twitter.com/drahilger
• Allison's motor speech lab: https://www.colorado.edu/lab/motor-speech/
• Timo's website: https://www.simplpoints.com/
• Timo on Twitter: https://twitter.com/TimoRoettger
• Bayesian...

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary, Blake Walters, Jonathan Morgan, Francesco Madrisotti, Ivy Huang, Gary Clarke, Robert Flannery, Rasmus Hindström, Stefan, Corey Abshire, Mike Loncaric, David McCormick, Ronald Legere, Sergio Dolia and Michael Cao.

Takeaways:

• Sharks play a crucial role in maintaining healthy ocean ecosystems.
• Bayesian statistics are particularly useful in data-poor environments like ecology.
• Teaching Bayesian statistics requires a shift in mindset from traditional statistical methods.
• The shark meat trade is significant and often overlooked.
• Ray meat trade is as large as shark meat trade, with specific markets dominating.
• Understanding the ecological roles of species is essential for effective conservation.
• Causal language is important in ecological research and should be encouraged.
• Evidence-driven decision-making is crucial in balancing human and ecological needs.
• Expert opinions are...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Takeaways:

• Bob's research focuses on corruption and political economy.
• Measuring corruption is challenging due to the unobservable nature of the behavior.
• The challenge of studying corruption lies in obtaining honest data.
• Innovative survey techniques, like randomized response, can help gather sensitive data.
• Non-traditional backgrounds can enhance statistical research perspectives.
• Bayesian methods are particularly useful for estimating latent variables.
• Bayesian methods shine in situations with prior information.
• Expert surveys can help estimate uncertain outcomes effectively.
• Bob's novel, 'The Bayesian Hitman,' explores academia through a fictional lens.
• Writing fiction can enhance academic writing skills and creativity.
• The importance of community in statistics is emphasized, especially in the Stan community.
• Real-time online surveys could revolutionize data collection in social science.

Chapters:

00:00 Introduction to Bayesian Statistics and Bob Kubinec

06:01 Bob's Academic Journey and Research Focus

12:40 Measuring Corruption: Challenges and Methods

18:54 Transition from Government to Academia

26:41 The Influence of Non-Traditional Backgrounds in Statistics

34:51 Bayesian Methods in Political Science Research

42:08 Bayesian Methods in COVID Measurement

51:12 The Journey of Writing a Novel

01:00:24 The Intersection of Fiction and Academia

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell,...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

If there is one guest I don’t need to introduce, it’s mister Andrew Gelman. So… I won’t! I will refer you back to his two previous appearances on the show though, because learning from Andrew is always a pleasure. So go ahead and listen to episodes 20 and 27.

In this episode, Andrew and I discuss his new book, Active Statistics, which focuses on teaching and learning statistics through active student participation. Like this episode, the book is divided into three parts: 1) The ideas of statistics, regression, and causal inference; 2) The value of storytelling to make statistical concepts more relatable and interesting; 3) The importance of teaching statistics in an active learning environment, where students are engaged in problem-solving and discussion.

And Andrew is so active and knowledgeable that we of course touched on a variety of other topics — but for that, you’ll have to listen ;)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser, Julio, Edvin Saveljev, Frederick Ayala, Jeffrey Powell, Gal Kampel, Adan Romero, Will Geary and Blake Walters.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

- Active learning is essential for teaching and learning statistics.

- Storytelling can make...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

Structural Equation Modeling (SEM) is a key framework in causal inference. As I’m diving deeper and deeper into these topics to teach them and, well, finally understand them, I was delighted to host Ed Merkle on the show.

A professor of psychological sciences at the University of Missouri, Ed discusses his work on Bayesian applications to psychometric models and model estimation, particularly in the context of Bayesian SEM. He explains the importance of BSEM in psychometrics and the challenges encountered in its estimation.

Ed also introduces his blavaan package in R, which enhances researchers' capabilities in BSEM and has been instrumental in the dissemination of these methods. Additionally, he explores the role of Bayesian methods in forecasting and crowdsourcing wisdom.

When he’s not thinking about stats and psychology, Ed can be found running, playing the piano, or playing 8-bit video games.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit https://www.patreon.com/learnbayesstats to unlock exclusive Bayesian swag ;)

Takeaways:

- Bayesian SEM is a powerful framework in psychometrics that allows for the estimation of complex models involving multiple variables and causal relationships.

-...

• My Intuitive Bayes Online Courses
• 1:1 Mentorship with me

In this episode, Dmitry Bagaev discusses his work in Bayesian statistics and the development of RxInfer.jl, a reactive message passing toolbox for Bayesian inference. 

Dmitry explains the concept of reactive message passing and its applications in real-time signal processing and autonomous systems. He discusses the challenges and benefits of using RxInfer.jl, including its scalability and efficiency in large probabilistic models. 

Dmitry also shares insights into the trade-offs involved in Bayesian inference architecture and the role of variational inference in RxInfer.jl. Additionally, he discusses his startup Lazy Dynamics and its goal of commercializing research in Bayesian inference. 

Finally, we also discuss the user-friendliness and trade-offs of different inference methods, the future developments of RxInfer, and the future of automated Bayesian inference. 

Coming from a very small town in Russia called Nizhnekamsk, Dmitry currently lives in the Netherlands, where he did his PhD. Before that, he graduated from the Computational Science and Modeling department of Moscow State University. 

Beyond that, Dmitry is also a drummer (you’ll see his cool drums if you’re watching on YouTube), and an adept of extreme sports, like skydiving, wakeboarding and skiing!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Thank you to my Patrons for making this episode possible!

Yusuke Saito, Avi Bryant, Ero Carrera, Giuliano Cruz, Tim Gasser, James Wade, Tradd Salvo, William Benton, James Ahloy, Robin Taylor,, Chad Scherrer, Zwelithini Tunyiswa, Bertrand Wilden, James Thompson, Stephen Oates, Gian Luca Di Tanna, Jack Wells, Matthew Maldonado, Ian Costley, Ally Salim, Larry Gill, Ian Moran, Paul Oreto, Colin Caprani, Colin Carroll, Nathaniel Burbank, Michael Osthege, Rémi Louf, Clive Edelsten, Henri Wallen, Hugo Botha, Vinh Nguyen, Marcin Elantkowski, Adam C. Smith, Will Kurt, Andrew Moskowitz, Hector Munoz, Marco Gorelli, Simon Kessell, Bradley Rode, Patrick Kelley, Rick Anderson, Casper de Bruin, Philippe Labonde, Michael Hankin, Cameron Smith, Tomáš Frýda, Ryan Wesslen, Andreas Netti, Riley King, Yoshiyuki Hamajima, Sven De Maeyer, Michael DeCrescenzo, Fergal M, Mason Yahr, Naoya Kanai, Steven Rowland, Aubrey Clayton, Jeannine Sue, Omri Har Shemesh, Scott Anthony Robson, Robert Yolken, Or Duek, Pavel Dusek, Paul Cox, Andreas Kröpelin, Raphaël R, Nicolas Rode, Gabriel Stechschulte, Arkady, Kurt TeKolste, Gergely Juhasz, Marcus Nölke, Maggi Mackintosh, Grant Pezzolesi, Avram Aelony, Joshua Meehl, Javier Sabio, Kristian Higgins, Alex Jones, Gregorio Aguilar, Matt Rosinski, Bart Trudeau, Luis Fonseca, Dante Gates, Matt Niccolls, Maksim Kuznecov, Michael Thomas, Luke Gorrie, Cory Kiser and Julio.

Visit

More generally, what is Bayesian thinking, philosophically? And is it really useful in every day life? Because, well you can’t fire up MCMC each time you need to make a quick decision under uncertainty… So how do you do that in practice, when you have at most a pen and paper?

In this episode, you’ll hear Max Sklar’s take on these questions. Max is a software engineer with a focus on machine learning and Bayesian inference. Now working at Foursquare’s innovation lab, he recently led the development of a causality model for Foursquare’s Ad Attribution product and taught a course on Bayesian Thinking at the Lviv Data Science Summer School.

Max is also an open-source enthusiast and a fellow podcaster – he’s the host of the Local Maximum podcast, where you can hear every week about the latest trends in AI, machine learning and technology from an engineering perspective.

Ow, and if you liked the movie « Her », with Joaquin Phoenix, well you’re in for a treat at the end of this episode…

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Local Maximum podcast website: https://www.localmaxradio.com
• Max on Twitter: https://twitter.com/maxsklar
• Bayesian linear models: https://github.com/maxsklar/BayesPy/tree/master/LinearModels
• Bayesian Dirichlet-Multinomial estimation: https://github.com/maxsklar/BayesPy/tree/master/DirichletEstimation
• Bayesian Thinking for Applied Machine Learning slides: https://docs.google.com/presentation/d/1eiceuvXlsoFKoHdqjF3qXBkyht7vR0YXQPG82ady-TU/edit?usp=sharing

Alex and Max discuss the integration of BoTorch with PyTorch, exploring its applications in Bayesian optimization and Gaussian processes. They highlight the advantages of using GPyTorch for structured matrices and the flexibility it offers for research.

The discussion also covers the motivations behind building BoTorch, the importance of open-source culture at Meta, and the role of PyTorch in modern machine learning.

Get the full discussion here.

Attend Alex's tutorial at PyData Berlin: A Beginner's Guide to State Space Modeling 

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Luke and Alex discuss the application of generative models in sports analytics. They emphasize the importance of Bayesian modeling to account for uncertainty and contextual variations in player data.

The discussion also covers the challenges of balancing model complexity with computational efficiency, the innovative ways to hack Bayesian models for improved performance, and the significance of understanding model fitting and discretization in statistical modeling.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

He did it in 2019 with PyMC3, for which he developed the API for ordinary differential equations. In this episode, he’ll tell us why and how he did that, what he learned from the experience, and what the strengths and weaknesses of the API are in his opinion.

Demetri is a Ph.D candidate in Biostatistics at Western University, in Ontario, Canada. His research interests surround machine learning and Bayesian statistics for personalized medicine. He earned his Master’s in Applied Mathematics from The University of Waterloo and is a firm believer in open science, interdisciplinary collaboration, and reproducible research. 

Other than that, he loves plotting data and drinking IPA beer – well, who doesn’t?”

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Demetri on Twitter: https://twitter.com/PhDemetri
• Demetri on GitHub: https://github.com/Dpananos
• Demetri's website: https://dpananos.github.io/
• PyMC3, Probabilistic Programming in Python: https://docs.pymc.io/
• Chris Bishop, Pattern Recognition and Machine Learning: https://www.amazon.fr/Pattern-Recognition-Machine-Learning-Christopher/dp/0387310738
• Bayesian Data Analysis (Gelman, Carlin, Stern, Dunson, Vehtari, Rubin): http://www.stat.columbia.edu/~gelman/book/
• Parallel Plots: https://arviz-devs.github.io/arviz/generated/arviz.plot_parallel.html

In this episode, Thomas Wiecki will come to the rescue and explain what multilevel models are, how to build them, what their powers are… but also why you should be very careful when building them…

Does the name Thomas Wiecki ring a bell? Probably because he’s the host and creator of the PyData Deep Dive Podcast, where he interviews open-source contributors from the Python and Data Science worlds! Thomas is also the VP of Data Science at Quantopian, a crowd-sourced quantitative investment firm that encourages people everywhere to write investment algorithms.

Finally, Thomas is a longtime Bayesian and core-developer of PyMC3, a fantastic python package to do probabilistic programming in Python. On his blog, he publishes tutorial articles and explores new ideas such as Bayesian Deep Learning. Caring a lot about open-source software sustainability, he puts all he’s up to on his Patreon page, that you’ll find in the show notes.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Thomas’ series on Hierarchical Regression: https://twiecki.io/blog/2013/08/12/bayesian-glms-1/
• Non-centered Parametrization with PyMC3: https://twiecki.io/blog/2017/02/08/bayesian-hierchical-non-centered/
• Using Bayesian Decision Making: https://twiecki.io/blog/2019/01/14/supply_chain/
• PyMC3 - Probabilistic Programming in Python: https://docs.pymc.io/
• Symbolic PyMC: https://pymc-devs.github.io/symbolic-pymc/
• PyData Deep Dive Podcast: https://pydata-podcast.com
• Thomas on Twitter: https://twitter.com/twiecki?lang=en
• Thomas on Patreon: https://www.patreon.com/twiecki
• Thomas on GitHub: https://github.com/twiecki
• Alex’s Hierarchical Model of Elections in Paris: https://mybinder.org/v2/gh/AlexAndorra/pollsposition_models/master?urlpath=%2Fvoila%2Frender%2Fdistrict-level%2Fmunic_model_analysis.ipynb

In this conversation, Alex and Maurizio delve into the intricacies of Gaussian processes and their deep learning counterparts. They explain the foundational concepts of Gaussian processes, the transition to deep Gaussian processes, and the advantages they offer in modeling complex data.

The discussion also touches on practical applications, model selection, and the evolving landscape of machine learning, particularly in relation to transfer learning and the integration of deep learning techniques with Gaussian processes.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Alexandre Andorra and Jordan Thibodeau discuss the transformative impact of AI on productivity, career opportunities in the tech industry, and the intricacies of the job interview process.

They emphasize the importance of expertise, networking, and the evolving landscape of tech companies, while also providing actionable advice for individuals looking to enhance their careers in AI and related fields.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Today’s clip is from episode 141 of the podcast, with Sam Witty.

Alex and Sam discuss the ChiRho project, delving into the intricacies of causal inference, particularly focusing on Do-Calculus, regression discontinuity designs, and Bayesian structural causal inference.

They explain ChiRho's design philosophy, emphasizing its modular and extensible nature, and highlights the importance of efficient estimation in causal inference, making complex statistical methods accessible to users without extensive expertise.

Get the full discussion here.

• Intro to Bayes Course (first 2 lessons free)
• Advanced Regression Course (first 2 lessons free)

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work!

Visit our Patreon page to unlock exclusive Bayesian swag ;)

Transcript

This is an automatic transcript and may therefore contain errors. Please get in touch if you're willing to correct them.

Well, rest assured, as you’ll hear from Michael Betancourt himself: it’s hard for everybody! That’s why over the years he developed and tries to popularize what he calls a « principled Bayesian workflow » — in a nutshell, think about what could have generated your data; and always question default settings!

With that workflow, you’ll probably feel less alone when modeling, but expect to fail often. That’s ok — as Michael says: if you don’t fail, you don’t learn!

Who is Michael Betancourt you ask? He is a physicist and statistician, whose research focuses on the development of robust statistical workflows, computational tools, and pedagogical resources that help bridge the gap between statistical theory and scientific practice.

Michael works a lot on differential geometry and probability theory, and he often lives in high-dimensional spaces, where he meets with a good friend of his -- Hamiltonian Monte Carlo. Then, you won’t be surprised to learn that Michael is one of the core developers of the seminal probabilistic programming language Stan.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Michael's upcoming course: https://events.eventzilla.net/e/introduction-to-bayesian-inference-with-stan-with-michael-betancourt-2138756860
• Michael's website (the “Writing” page collects the case studies and pedagogical material, and the “Speaking” page links to the recorded talks): https://betanalpha.github.io/
• Support Michael's work on Patreon: https://patreon.com/betanalpha
• Michael on Twitter: https://twitter.com/betanalpha
• Michael on GitHub: https://github.com/betanalpha
• Stan probabilistic programming langage: https://mc-stan.org/

And here is my second question: Are you working in biomedicine? And if you do, are you using Bayesian tools? Then how do you get your co-workers more used to posterior distributions than p-values? In other words, how do you change behaviors in a large organization?

In this episode, Eric Ma will answer all these questions and even tell us his favorite modeling techniques, which problems he encountered with these models, and how he solved them. He’ll also share with us the software-engineering workflow he uses at Novartis to share his work with colleagues.

Eric is a data scientist at the Novartis Institutes for Biomedical Research, where he focuses on Bayesian statistical methods to make medicines for patients. Eric is also a prolific open source developer: he led the development of pyjanitor, an API for cleaning data in Python, and nxviz, a visualization package for NetworkX. He also contributes to PyMC3, matplotlib and bokeh.

This is « Learning Bayesian Statistics », episode 5, recorded October 21, 2019.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ !

Links from the show:

• Eric's website: https://ericmjl.github.io/
• Eric on Twitter: https://twitter.com/ericmjl
• Bayesian analysis recipes: https://github.com/ericmjl/bayesian-analysis-recipes
• Bayesian deep learning demystified: https://github.com/ericmjl/bayesian-deep-learning-demystified
• Causality repo: https://github.com/ericmjl/causality
• Pyjanitor - Convenient data cleaning routines for repetitive tasks: https://pyjanitor.readthedocs.io/
• PyMC3 - Probabilistic Programming in Python: https://docs.pymc.io/
• Panel - A high-level app and dashboarding solution for Python: https://panel.pyviz.org/
• Nxviz - Visualization Package for NetworkX: https://nxviz.readthedocs.io/en/latest/

In this episode, Karin will share with us the vital and essential work she does to understand aspects of neurodegenerative diseases. She’ll also tell us more about computational neuroscience and Dirichlet processes — what they are, what they do, and when you should use them.

Karin did her doctorate in mathematics, with a focus on compressive sensing and computational neuroscience at the University of Texas at Austin. Her doctoral work included applying hierarchical Dirichlet processes in the setting of neural data and focused on one-bit compressive sensing and spike-sorting.

Formerly the chair of the math and computer science department of Phillips Academy Andover, she started a postdoc at Mass General Hospital and Harvard Medical in Fall 2019. Most importantly, rock climbing and hiking have no secrets for her!

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/ ! 

Links from the show, personally curated by Karin Knudson:

• Karin on Twitter: https://twitter.com/karinknudson
• Spike train entropy-rate estimation using hierarchical Dirichlet process priors (Knudson and Pillow): https://pillowlab.princeton.edu/pubs/abs_Knudson_HDPentropy_NIPS13.html
• Fighting Gerrymandering with PyMC3, PyCon 2018, Colin Carroll and Karin Knudson: https://www.youtube.com/watch?v=G9I5ZnkWR0A
• Expository resources on Dirichlet Processes: Chapter 23 of Bayesian Data Analysis (Gelman et al.) and http://www.gatsby.ucl.ac.uk/~ywteh/research/npbayes/dp.pdf
• Hierarchical Dirichlet Processes (introduced the HDP and included applications in topic modeling and for working with time-series data and Hidden Markov Models): https://www.stat.berkeley.edu/~aldous/206-Exch/Papers/hierarchical_dirichlet.pdf
• A Sticky HDP-HMM with applications to speaker diarization (a nice example of how the HDP can be used with HMM, in this case cleverly adapted so that states have more persistence): https://arxiv.org/abs/0905.2592
• If you want to get deeper into the weeds and also get a sense of the history: Dirichlet Processes with Applications to Bayesian Nonparametric Problems (https://projecteuclid.org/euclid.aos/1176342871) and A Bayesian Analysis of Some Nonparametric Problems (https://projecteuclid.org/euclid.aos/1176342360)

Colin Carroll will answer all these questions for you. Colin is a machine learning researcher and software engineer who’s notably worked on modeling risk in the airline industry and building NLP-powered search infrastructure for finance. He’s also an active contributor to open source, particularly to the popular PyMC3 and ArviZ libraries.

Having studied geometric measure theory at Rice University, Colin was bound to walk in the woods with Pete the pup – who was there when we recorded by the way – and to launch balloons into near-space in his spare time.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com/!

Links from the show:

• Colin's blog: https://colindcarroll.com/
• Colin on Twitter: https://twitter.com/colindcarroll
• Colin on GitHub: https://github.com/ColCarroll
• Very parallel MCMC sampling: https://colindcarroll.com/2019/08/18/very-parallel-mcmc-sampling/
• A tour of probabilistic programming APIs: https://colindcarroll.com/2019/07/23/a-tour-of-probabilistic-programming-apis/
• PyMC3, Probabilistic Programming in Python: https://docs.pymc.io/
• Stan: https://mc-stan.org/
• Pyro, Deep Universal Probabilistic Programming: https://pyro.ai/
• ArviZ, Exploratory analysis of Bayesian models: https://arviz-devs.github.io/arviz/ 
• PyMC-Learn, Probabilistic models for machine learning: https://www.pymc-learn.org/
• Facebook’s Prophet uses Stan: https://statmodeling.stat.columbia.edu/2017/03/01/facebooks-prophet-uses-stan/
• Prophet in PyMC3: https://github.com/luke14free/pm-prophet

In this episode, you’ll hear Chris Fonnesbeck answer these questions from the perspective of marine biology and sports analytics. Chris is indeed the New York Yankees’ senior quantitative analyst and an associate professor at Vanderbilt University School of Medicine. 

He specializes in computational statistics, Bayesian methods, meta-analysis, and applied decision analysis. He also created PyMC, a library to do probabilistic programming in python, and is the author of several tutorials at PyCon and PyData conferences.

Our theme music is « Good Bayesian », by Baba Brinkman (feat MC Lars and Mega Ran). Check out his awesome work at https://bababrinkman.com!

Links from the show:

• Chris on Twitter: https://twitter.com/fonnesbeck
• PyMC3, Probabilistic Programming in Python: https://docs.pymc.io/
• Chris on GitHub: https://github.com/fonnesbeck
• An introduction to Markov Chain Monte Carlo using PyMC3 - PyData London 2019: https://www.youtube.com/watch?v=SS_pqgFziAg
• Introduction to Statistical Modeling with Python - PyCon 2017 - video: https://www.youtube.com/watch?v=TMmSESkhRtI
• Introduction to Statistical Modeling with Python - PyCon 2017 - code repo: https://github.com/fonnesbeck/intro_stat_modeling_2017
• Bayesian Non-parametric Models for Data Science using PyMC3 - PyCon 2018: https://www.youtube.com/watch?v=-sIOMs4MSuA
• Statistical Data Analysis in Python: https://github.com/fonnesbeck/statistical-analysis-python-tutorial

Get early access to Alex's next live-cohort courses!

Today’s clip is from episode 142 of the podcast, with Gabriel Stechschulte.