Efficient and Agile Data Pipeline for Universal Data Access

Efficient and Agile Data Pipeline for Universal Data Access

Tuesday, May 23, 2023 2:00 PM to 2:20 PM · 20 min. (Europe/Berlin)
Hall H, Booth K1001 - Ground Floor
HPC Solutions Forum
Autonomous DrivingBig Data AnalyticsManaging Extreme-Scale ParallelismResource DisaggregationWorkflows from Edge to Cloud

Information

Data pipelines are challenging enough, from ingesting the right sources, processing the correct data and implementing BI to drive actionable results, to burdening yourself with inefficient, short lived, complex infrastructure choices. When your data pipeline hits its maximum velocity it is important to be able to spin up and down new resources to accommodate the burst in load. Data is not always delivered at a constant rate so converting, cleaning and tagging must be possible without backlogs, to drive on time results. Your data pipeline foundation needs to scale from day zero to production rollout, driven by simplicity to enable faster time to actionable results.
HPC Solutions Forum Topics
How is high-performance storage in the 2020s different from what it looked like in the 2010s?How should an organization determine the proper balance between cloud and on-prem, for performance, scalability, and TCO?Discuss the software development considerations in balancing performance, scalability, and portability.
Format
On-site
Beginner Level
50%
Intermediate Level
40%
Advanced Level
10%

Log in