Jun 2 – 6, 2025
Fluno Center on the University of Wisconsin-Madison Campus
America/Chicago timezone

Using the National Data Platform Endpoint to Improve Access to Science Data

Jun 6, 2025, 11:55 AM
20m
Howard Auditorium (Fluno Center on the University of Wisconsin-Madison Campus)

Howard Auditorium

Fluno Center on the University of Wisconsin-Madison Campus

601 University Avenue, Madison, WI 53715-1035

Speaker

Curt Dodds (Institute for Astronomy, University of Hawaii)

Description

I describe the process of deploying the National Data Platform Endpoint (formerly Point of Presence / POP) on local infrastructure to provide a data streaming service for a published science dataset where the data origin is located in Hawaii. From the perspective of a software engineer I will cover the process of deploying the endpoint into a Kubernetes cluster or using Docker Compose. I will explain how I integrated access to local data with the endpoint and describe some useful lessons that were learned. Finally, from the perspective of a science user, I will demonstrate how to use the deployed endpoint to preprocess data and stream the results to a Jupyter notebook to visualize the data.

Primary author

Curt Dodds (Institute for Astronomy, University of Hawaii)

Presentation materials