There are 4 main types of AI/ML capabilities at Livermore Computing. These services are linked to in the boxes below. See also, other consulting services or capabilities below the boxes.
AI Software and Tools
LC has a variety of software and tools to support AI/ML use cases on LC systems. These include:
Machine Learning Frameworks
PyTorch is available on LC systems.
Jupyter Notebooks provide an interactive environment for developing and testing machine learning models using frameworks like PyTorch. For setup instructions and best practices on LC systems, please see "Orbit" and Jupyter notebooks".
Machine Learning Visualization
TensorBoard is available on LC. Please see Using TensorBoard on Login Nodes for info about how to run it securely.
Machine Learning Workflow Tools
If you're looking for a workflow orchestration tool, we recommend Merlin, which supports HPC workflows and scalability for ML-typical workflows composed of many jobs.
LC's Workflow Enablement Group supports Merlin by providing you with the required Persistent Data Services in LaunchIT.
AI/ML Services
Please see our AI/ML services page for information about LLMs hosted on LC (service called LLamaMe) and how to get API keys in LaunchIT. (available in all LC network zones CZ, RZ, and SCF).
We support GitLab Duo on the CZ and RZ. For more information, see our LC GitLab Duo (Pilot) page.
AI/ML Hardware
Our systems that include GPUs are listed at Compute Platforms with GPUs.
AI/ML Data Storage and Sharing
We recommend our VAST filesystems for AI/ML workloads; VAST provides scalability for workloads that include working with many small input/output files and frequent I/O operations.
We also offer object storage compatible with the S3 protocol.
If you need to share models or other data with a group of collaborators, please don’t hesitate to reach out to us. We can create shared directories for groups of users upon request and are actively exploring additional solutions to facilitate model sharing.
Additional Consulting Services
In addition to consulting services related to the areas above, LC offers other consulting services:
Development
Contact the LC Hotline, and they will direct you to the appropriate person.
- Performance Optimization
- Debugging
- Compilers
HPC Center Usage
We have dedicated teams of subject area experts available:
- Technical Consultants | lc-hotline@llnl.gov | or call (925) 422-4531 (offsite) or 2-4531 (onsite)
- LC Operations (24/7) | mfopers@llnl.gov
Additional Capabilities
Most LC Capabilities fall into one of the major categories above.
FIS: File Transfer to iSRD / iSNSI
FIS is a crucial capability that does not fall into any of the above categories.
What is FIS?
LC supports one way link (OWL) connections that allow one way transfers from the unclassified (EN, CZ, RZ) to the classified networks (iSNSI, iSRD) at LLNL. Full instructions can be found at: hpc.llnl.gov/documentation/user-guides/using-lc-file-interchange-service-fis