• Data Management, Visualization, and Analysis of Experimental and Observational Data (EOD) Workshop
    09/29/2015 - 10/01/2015

Data Management, Visualization, and Analysis of Experimental and Observational Data (EOD) Workshop

The Data Management, Visualization, and Analysis of Experimental and Observational Data (EOD) Workshop is aimed at helping ASCR and the research community better understand data management, analysis and visualization needs related to user facilities operated/supported by other Office of Science program offices. A representative crosscut of application scientists will prepare a use-case template that will include: science goals; a workflow diagram; description of expected data rates; process(es) used for data management and analysis; bottlenecks and points in the process that are cumbersome; vision for data-centric activities they’d like to accomplish but are presently unable to achieve; ideas for having data-centric activities, like analysis, keep pace with data generation and acquisition rates. Together with computer and computational scientists and mathematicians, discussion will focus on identifying a common vision for meeting these scientific needs and objectives. A workshop report will capture the science drivers, summarize major themes, and suggest directions for future research aimed at helping to fulfill these data-centric science needs.


DoubleTree by Hilton
8210 Wisconsin Ave.
Bethesda, MD 20814-3624
United States

Point of Contact

Dr. Wes Bethel

Involved Programs/Projects

Lucy Nowell


Tuesday 9/29

7:00-8:00 - registration, continental breakfast

8:00-8:15 - Introductory comments, logistics (ORISE, Wes Bethel, and Lucy Nowell) (Plenary)

8:15-9:30 - Tony Hey (UW) presentation and discussion (Plenary)

9:30-10:20 - First 2 of 5 BES science talks @25mins each (Plenary) (Parazzo, Parkinson)

10:20-10:50 BREAK

10:50-12:05 - 3 remaining BES science talks @25 mins (Plenary) (Granroth, Toby, Kalinin)

12:05-1:00 Lunch

1:00-2:30 Science-focused discussion (see note below)

2:30-3:00 BREAK

3:00-4:00 Lightning round presentations (see note below) (Plenary)

4:00-4:30 Science feedback (see note below) (Plenary)

4:30-5:00 Discussion: about process that we are using in this meeting, how we might do it better (Plenary)

Dinner: on your own


Wednesday, 9/30

7:00-8:00 Continental breakfast

8:00-8:10 Regroup and reminders about the day (Plenary)

8:10-9:50 HEP Science talks - (4 @25) (Plenary) (Potekhin, Roser, Szalay, Habib)

9:50-10:05 BREAK

10:05-11:15 Science-focused discussion

11:15-12:00 Lightning round (Plenary)

12:00-12:30 Science feedback (Plenary)

12:30-1:15 Lunch

1:30-2:45 BER Science talks (3 @25) (Plenary) (Riihimaki, Rasch, Williams, Wiley) (yes, that's 4 talks, not 3)

2:45-4:00 BREAK+Science-focused discussion

4:00-4:45 Lightning round presentations (Plenary)

4:45-5:15 Science feedback (Plenary)

5:15-5:30 Instructions for overnight (Plenary)

Dinner: on your own


Thursday, 10/1

7:00-8:00 Continental breakfast

8:00-8:10 Regroup

8:10-8:40 CS and Math summaries of challenges (Plenary)

8:40-10:00 Research-focused discussion (Plenary)

8:10-10:00: "Bucket work"

10:00-10:30 BREAK (and hotel checkout)

10:30-11:30 Report back and discussion (Plenary)

11:30-12:00 Science feedback (Plenary)

12:00-12:10 Roadmap for the afternoon (Plenary)

12:00-1:00 Lunch

1:00-3:00 Writing assignments and discussion (Plenary)

3:00  Workshop adjourns




Science-focused discussion: For these sessions, we will divide into two breakouts, and divide the science and CS/Math attendees equally to discuss the science challenges. The CS/Math folks will draft list of research challenges that will help to meet science needs, and prepare lightning round talking points.


Lightning round presentation: Each Math/CS person presents the top N (N=3..6) issues/challenges in the science presentations/discussions as viewed through the lens of their particular area. The amount of time for lightning round presentations shrinks over time, starting at 2 mins early in the workshop, going down to 1 min later in the workshop.


Science Feedback: this activity immediately follows the lightning round presentations, and will be an opportunity for the science participants to provide immediate feedback to the non-science participants.




My presentation to the committee -- on Fermilab's program and challenges in the area of data science

Breakout Notes

Posted by Rob Roser on 10/01/2015
Rob Roser Report articulates Fermilab's program going forward and how that translates into computing/data challenges
Posted by Dr. Wes Bethel on 09/29/2015
Salman Habib (ANL), et al. Contributors (from the ASCR/HEP Exascale Requirements Review): S. Bailey1, D. Bard1, A. Borgland2, J. Borrill1, K. Heitmann3, P. Nugent1, N. Padmanabhan4, D. Petravick5 1 Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720 2 SLAC National Accelerator Laboratory, 2575 Sand Hill Road, Menlo Park, CA 94025 3 Argonne National Laboratory, 9700 S. Cass Ave., Lemont, IL 60439 4 Yale University, New Haven, CT 06520 5 National Center for Supercomputing Applications, Urbana, IL 61801
Posted by Dr. Wes Bethel on 09/25/2015
Kerstin Kleese van Dam, Brookhaven National Laboratory Kerstin was kind enough to share this information with us for the purpose of providing more information about needs of the science community, particularly BER. The survey was conducted in preparation for the 'Data and Informatics Working Group on Virtual Data Integration - Requirements Workshop' organized by the Climate and Environmental Sciences Division (CESD) within the Office of Biological and Environmental Research (BER), program manager Justin Hnilo.
Posted by Dr. Wes Bethel on 09/24/2015
Dilworth Y. Parkinson, Alexander Hexemer, Craig E. Tull Lawrence Berkeley National Laboratory
Posted by Dr. Wes Bethel on 09/23/2015
H. Steven Wiley, Samuel H Payne and Matthew E Monroe Environmental Molecular Sciences Laboratory Pacific Northwest National Laboratory Richland, WA 99354
Posted by Dr. Wes Bethel on 09/23/2015
Amedeo Perazzo SLAC National Accelerator Laboratory
Posted by Dr. Wes Bethel on 09/23/2015
Philip J. Rasch Pacific Northwest National Laboratory
Posted by Dr. Wes Bethel on 09/21/2015
Laura D. Riihimaki and Chitra Sivaraman, Pacific Northwest National Laboratory
Posted by Dr. Wes Bethel on 09/21/2015
S.V. Kalinin,1,2 A. Belianinov,1,2 A. Lupini,1,3 S. Somnath,1,2 E. Strelcov,1,2 S. Jesse1,2 1 Institute for Functional Imaging of Materials, 2 The Center for Nanophase Materials Sciences, and 3 Materials Sciences and Technology Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831 9/24/2015 09:17PDT: This use case consists of 4 PDFs rolled up into one big one.
Posted by Dr. Wes Bethel on 09/21/2015
Brian H. Toby Advanced Photon Source, Argonne
Posted by Dr. Wes Bethel on 09/21/2015
Alexander S. Szalay The Johns Hopkins University
Posted by Dr. Wes Bethel on 09/21/2015
Tom Junk (FNAL), Amir Farbin (UTA), Maxim Potekhin (BNL), Craig Tull (LBNL), Brett Viren (BNL)
Posted by Dr. Wes Bethel on 09/21/2015
Garrett E. Granroth and Thomas Proffen Neutron Data Analysis and Visualization Division, Oak Ridge National Laboratory