A key design goal of PipeBook is to break away from the single-browser-window user experience of traditional data notebooks, to take full advantage of the large screens on today's laptops and desktops. The PipeBook Multi-Window User Experience (Live prototype, annotated) Windows In particular, a single PipeBook "document" consists of: The Pipe window, which can toggle... Continue Reading →
PipeBook.yml: Reimagining Notebooks as Resilient Data Pipelines
See Also The Data Config by Benn Stancil (Medium)https://github.com/TheSwanFactory/pipebook (App)PipeBook: UX Design Brief (Blog)https://github.com/TheSwanFactory/fridaay (Framework)Data on Rails: Solving the Data App Imperative (YouTube) Overview The modern data notebook has its roots in academic tools for mathematical research. Because of that, notebooks are fantastic for open-ended exploration, but an awkward match for production data pipelines. In... Continue Reading →
Analytics Anonymous: The Missing Peace of the Modern Data Stack
Pitch 2 for Coalesce 2022 (unsubmitted) While we love great technology, I bet most of us embraced the Modern Data Stack in order to positively impact human beings: our business, our industry, and our society. But if you're like me, you've discovered the problems you care most about might not be solvable by current (or... Continue Reading →
Pitch: Data is a Feature, not a Product
In this provocative talk Dr. Ernest N. Prabhakar, former Open Source Product Manager at Apple, argues that is time for our industry to reorganize around "decisions" rather than "data."
How to Build LightDash from Source
LightDash is a super-cool Open Source business intelligence tool built on top of DBT (which I think of as node for SQL). While it is distributed as open source, the usual way to deploy it locally is by simply running a docker container. If you want to actually built lightdash directly from source yourself, you... Continue Reading →
From “Zombie Data” to “Smart Reports”
I call this "zombie data" because it: * Lacks any self-awareness * Doesn't remember where it came from * Has no relationship to its current context * Infects everyone it touches with that same mindlessness.
The Reporting Control Center
aka Quilt Data Hub or Lightdash 2.0? Challenge Can I evangelizea corporate data platformby just emailing out reportswith sufficiently smart URLs? Rationale I don't have the powerto pull others onto a new platform.But I can push useful data to othersin a way that inspires them to participate more directly with the platform Proposal Replace friendly... Continue Reading →
The Coherency Manifesto: Towards Communal Data Platforms
Version 1.0: Sep 11, 2021 (Interdependence Day) As a communitywho produces, consumes, and manages datawe hold these truths to be self-evident: Our most precious resource as a community is our ability to make better decisions together ("Coherency")Better decisions are enabled by higher Quality DataCoherency increases as our Communal Data Platform aligns the Syntax of producers... Continue Reading →
Psycho-Analytic Engineering (Coalesce 2021)
Using Data to Differentiate Our Selves Keynote Talk Proposal for Coalesce 2021 Google Slides Based on "DBT as Organizational Therapy" Pitch Video https://www.loom.com/share/58c52bb915da4d57a66995f618194ce8 More powerful tools and shorter cycle times mean that we analytics engineers “get to” spend less time on coding SQL and “have to” spend more time understanding the deeper needs, motivations, and... Continue Reading →
DBT as the “Couch” for Organizational Therapy
Or, "How ELTT is the Key to World Peace" Draft Submission Script for Coalesce 2021 Hey there Data Lovers, my name is Dr. Ernie. And this is my English Cocker Spaniel Qhuinn, who with me and my boss make up the IT department at a Palo Alto startup. I am Caltech physicist turned management consultant... Continue Reading →

You must be logged in to post a comment.