Published onMarch 15, 2023Building Data Pipelines at Scale: Lessons from NYCdata-engineeringbigquerygcppipelineKey lessons learned building production data pipelines at a NYC-based startup, from schema design to real-time processing