The Databricks Diaries cover art

The Databricks Diaries

The Databricks Diaries

By: Daniel Thornton
Listen for free

Have you ever wondered how top companies are harnessing the power of data to drive innovation and stay ahead of the competition? In this podcast, we’ll be speaking to some of the best industry minds and unlocking the secrets to leveraging data like never before. Ready for a data deep dive?Copyright 2026 Daniel Thornton Career Success Economics
Episodes
  • How Data Science Teams Should Prepare for AI-Driven Change
    May 27 2026

    In this episode of The Databricks Diaries, Andy Davis speaks with Sindy Yick, Head of Data Science and Machine Learning at Markerstudy Group, as part of our ongoing AI readiness series.

    Sindy brings a valuable data science perspective to the conversation, exploring why AI readiness is not just about adopting the latest tools or building agents. Instead, it starts with strong data foundations, good system design and a clear understanding of where AI can genuinely add value.

    The conversation also tackles one of the more difficult topics in AI adoption: the anxiety technical teams feel around AI agents and automation. Sindy shares her view on why AI should be treated as an assistant rather than a replacement, why junior talent still matters, and how organisations may need to rethink how they train and develop early-career data professionals.

    Show notes

    In this episode, we cover:

    • Why data quality and system foundations come before AI adoption
    • The “garbage in, garbage out” risk when applying AI to poor-quality data
    • How data science and machine learning teams are reacting to rapid AI change
    • The impact of coding agents on junior data science and engineering roles
    • Why AI is more likely to assist technical teams than fully replace them in the near term
    • The importance of stakeholder engagement, business knowledge and industry context
    • How organisations may need to rethink graduate and junior training pathways
    • Why human judgement, communication and strategic thinking are becoming more valuable
    • Potential AI use cases across insurance, including operations and underwriting
    • The importance of guardrails when moving AI closer to customer-facing or front-end applications
    • Sindy’s advice for data science leaders: stay open-minded and keep adapting

    AI readiness is not just about adopting the latest model or building the next agent.

    In this episode, Andy Davis speaks with Sindy Yick, Head of Data Science and Machine Learning at Markerstudy Group, about why strong data foundations, guardrails and human skills are critical to making AI work in practice.

    They also explore the future of junior technical roles, the rise of coding agents, and why business knowledge, stakeholder engagement and adaptability may become the most important skills for data science teams in the years ahead.

    Show More Show Less
    21 mins
  • A Data Leaders Journey - Kieran Poynton
    May 19 2026

    In this episode of the Databricks Diaries, Daniel is joined by Kieran Pointon, Director of Data & Analytics at Bromford Flagship LiveWest — one of the largest housing providers in the UK with around 120,000 homes following a recent three-way merger.

    Kieran brings 20+ years of experience across data engineering, BI, and enterprise architecture, including leadership roles at Halfords and Adidas. In this conversation, he opens up about the realities of merging three data teams, why he's betting on Microsoft Fabric over Databricks for his current platform, and how data science is helping real people get into work, education, and safer homes.

    What's covered:

    • Kieran's journey from headphones-on software engineer to data leader — and how being an introvert shaped his leadership style
    • Why "listen before you speak" is his number one piece of leadership advice
    • Building a high-performing data team at Halfords that could run without him
    • Merging Bromford, Flagship, and LiveWest — three teams, three landscapes, three ERPs
    • Why he chose Microsoft Fabric over Databricks for the new platform (and the five-year bet behind that decision)
    • The "left brain vs right brain" model: where the technology approach and business approach meet in the middle
    • Real data science use cases changing tenants' lives — condensation/damp/mould prediction, customer complaint modelling, and the "Pipeline of Talent" NLP model that's helped 450+ customers into work and education
    • How to get exec and board buy-in for data and AI initiatives
    • What makes the best analytics team — and why it's not always about the best tools or the best engineers
    • Honest advice for any data leader facing a merger or acquisition

    Show More Show Less
    44 mins
  • Data In The Boardroom with James Blagg
    May 12 2026

    In this episode of the Databricks Diaries, Daniel is joined by James Blagg, a seasoned Chief Data Officer with over 25 years of experience leading data strategy, architecture, and modernisation programmes across financial services.

    James shares hard-won lessons from a career that spans the 2008 financial crisis, the big data hype cycle, the move from Teradata appliances to cloud-native platforms, and now the AI wave. It's a candid conversation about what actually drives value in data — and the gap between vendor promises and operational reality.

    What's covered:

    • James's career journey from Oracle PL/SQL developer to CDO
    • Leading BI teams at Lloyds through the financial crisis and the HBOS integration
    • Nationwide's data simplification programme and the "almost cloud" Teradata investment
    • How platform evaluation has changed — and why cost, skills, and relationships now matter more than features
    • Why "it's on the roadmap" is the most dangerous phrase in vendor selection
    • The MVP hypothesis approach to picking analytics use cases
    • Why so many data warehouse projects are perceived as failures (and why metadata investment is finally fixing it)
    • Where AI really sits on the maturity curve — and why financial services is 10–15 years away from full back-office adoption
    • A practical playbook for governance, cost monitoring, and security guardrails before scaling AI on Databricks
    • The truth about cloud consumption pricing and reserved pricing deals

    Show More Show Less
    48 mins
adbl_web_anon_alc_button_suppression_c
No reviews yet