Driving DataOps Culture with LinkedIn DataHub

Your data is not changing slowly, so why should your metadata?

LinkedIn DataHub was open-sourced to enable other organizations to harness the power of metadata and unleash excellent DataOps practices. Doing DataOps well requires bringing together multiple disciplines of data science, data analytics, and data engineering into a cohesive unit. However, this is complicated, because there are a wide variety of data tools that are in use by these different tribes. Shirshanka, who founded and architected DataHub at LinkedIn, will describe its journey in enabling DataOps use-cases on top of the metadata platform. He will also showcase the latest integrations and features in the tool and share the roadmap for the project.

shirshanka-das-acryl.png

Shirshanka Das, Co-Founder & CTO @ Acryl Data

My mission is to make engineers productive with data, ethically. I am a technical lead in the Data team at LinkedIn. I like solving large scale challenges in distributed data systems. I've built several data infrastructure projects at LinkedIn, some of which are open source: Apache Helix, Espresso and Databus.

I'm involved in the following projects aimed at simplifying the big data management space: Apache Gobblin (incubating), LinkedIn DataHub, Apache Pinot (incubating) and Dali.

What is DataOps Unleashed?

DataOps Unleashed is the official DataOps community.

We came together on March 17 as the emergence of DataOps, CloudOps, AIOps, MLOps, and other professionals, who gathered virtually to share the latest trends and best practices for running, managing, and monitoring data pipelines and data-intensive analytics workloads.

Sessions included talks by DataOps professionals at leading organizations, detailing how they’re establishing data predictability, increasing reliability, and reducing costs.

Join us in Winter 2022 for the next DataOps Unleashed!

What is the cost to watch the virtual sessions?

DataOps Unleashed is always free and open for all to attend and view on-demand.

Join us for sessions on:

  • Data pipelines
  • Data orchestration
  • Metadata
  • Data quality
  • Data governance
  • Data science platforms
  • AIOps and MLOps
  • CloudOps
  • Migrations
  • Observability
  • Optimization
  • Operations

Who comes to DataOps Unleashed?

DataOps professionals and experts including data administrators, data architects, data engineers, data analysts, AI/ML professionals, and data technology leadership.

If you'd like to speak at DataOps Unleashed, send a note to astronaut@solutionmonday.com.

New to DataOps?

DataOps is a holistic approach to the creation, deployment, monitoring, management, and optimization of data-driven applications. It describes the culture and rules of engagement that allow data teams to deliver and maintain high-quality, on-time data products, often powered by AI and machine learning, in an agile and cost-effective way.

DataOps defines how data teams work and also affects data consumers and those whose work causes new data to be created and used within the organization. Their work enables the entire organization to access data efficiently for data-driven decision-making and for the creation and delivery of data-driven applications.

Organizations with well-developed DataOps strategies, governance, and processes can expedite the delivery of data-driven workflows and results faster and better than others.

 

Sign up below to join us in 2022 at the next DataOps Unleashed

Thank you to all of our sponsors