DELL Deploy High Performance Generative Solutions for The Enterprise User Guide

June 13, 2024
Dell

DELL Deploy High-Performance Generative Solutions for The Enterprise

Product Information

The Validated Design for AI Solution Brief is a comprehensive solution that enables the deployment of high-performance Generative AI solutions for the enterprise. It leverages the PowerEdge and PowerScale systems from Dell Technologies, along with the NVIDIA AI Enterprise platform and the NVIDIA NeMo framework. This solution unlocks the power of large language models (LLMs) for accelerated AI outcomes, allowing businesses to streamline deployments, drive trusted AI, and boost productivity.

The solution is designed to simplify the adoption of generative AI for business transformation. It addresses the complexity traditionally associated with deploying AI in production, ensuring that approaches, data strategies, privacy, security, and infrastructure are appropriately aligned. With this solution, businesses can automate repetitive tasks, revolutionize industries, and improve productivity across the organization.

Technical Specifications:

  • Compute: The solution utilizes Dell PowerEdge XE and rackservers, such as XE9680, XE8640, and R760xa, for training and inferencing. It also includes NVIDIA H100 Tensor Core GPUs with NVLink and NVSwitch for training and inferencing purposes.
  • Networking: NVIDIA Networking and Dell PowerSwitch Z9432F are used for network connectivity.
  • Software: The solution includes Dell OpenManage Enterprise, Power Manager, CloudIQ, NVIDIA AI Enterprise, Base Command, and NeMo framework for LLMs.
  • Storage: Dell PowerScale F900, F600, and Dell ECS Dell ObjectScale provide fast and ample data lake storage for GenerativeAI and large language models.

Project Helix is a strategic approach offered by Dell Technologies to adopt Generative AI validated foundations. It combines the PowerEdge, PowerScale, and NVIDIA innovations to simplify and speed up LLM, GPT, and NLP AI projects to produce results. By partnering with NVIDIA, Dell Technologies enables and accelerates Generative AI workloads, delivering engineering-validated hardware and software to meet customer needs across all businesses and verticals. The collaboration allows businesses to deploy AI solutions that accelerate digital transformation and improve decision-making through real-time data.

Product Usage Instructions

To use the Validated Design for AI Solution Brief, follow these steps:

  1. Ensure that your infrastructure is aligned with the recommended approaches, data strategies, privacy, and security measures mentioned in the user manual.
  2. Set up the required compute resources by deploying DellPowerEdge XE or rack servers, such as XE9680, XE8640, and R760xa.
  3. Install the necessary accelerators, including NVIDIA H100Tensor Core GPUs with NVLink and NVSwitch for training and inferencing purposes.
  4. Establish network connectivity using NVIDIA Networking and Dell PowerSwitch Z9432F.
  5. Install the software components, including Dell OpenManageEnterprise, Power Manager, CloudIQ, NVIDIA AI Enterprise, BaseCommand, and NeMo framework for LLMs.
  6. Set up the recommended storage solution using Dell PowerScaleF900, F600, or Dell ECS Dell ObjectScale for fast and ample data lake storage.
  7. Once the infrastructure is in place, follow the guidelines provided in the user manual to build, customize, and deploy regenerative AI models with billions of parameters using the NVIDIA NeMo framework.

By following these instructions, you can leverage the Validated Design for AI Solution Brief to unlock the power of large language models and accelerate your enterprise AI outcomes.

Deploy high-performance Generative AI solutions for the enterprise

Unlock the power of large language models for accelerated enterprise AI outcomes with PowerEdge, PowerScale, and NVIDIA AI Enterprise with the NVIDIA NeMo framework.

Accelerate business outcomes and increase productivity.

  • Move quickly with GenAI: Innovation, performance, and comprehensive solutions enable faster decision-making and insights from your proprietary data and operations.
  • Streamline deployments: Scale purpose-built, custom models, reduce enablement complexity and democratize business-wide with consistent architectures.
  • Drive trusted AI: Deploy a secure, high-quality on-premise foundation, with data privacy, boosting trusted decision-making from your data.

Use cases for Generative AI are expanding as the potential emerges to automate more repetitive tasks for employees, driving up productivity:

Digital Assistants including retail, business operations, sales, Legal, HR and hiring, call center.

  • Developer: Code generation and code efficiency, UI/UX design.
  • Creative, sales and marketing scripting, creative content generation.
  • Healthcare, research sciences, medical.

With Project Helix, in collaboration with NVIDIA, enterprises small and large across every industry and geography can harness the potential of Generative AI on their proprietary data business-wide, to accelerate productivity and enhance their business transformation strategy. This jointly engineered solution of leading, innovative Dell infrastructure and software, combined with NVIDIA acceleration innovation, NVIDIA AI Enterprise software which includes NeMo, a framework of resources designed specifically to streamline Generative AI workstreams, gives AI data scientists, developers, and decision- makers the solution they need to deliver critical guidance, recommendations and insights from billions of data points.

Streamline AI adoption for business transformation

Businesses have already kicked off and scaled many of their traditional AI initiatives into production, though many still encounter roadblocks to success to getting there, including deriving real value and ensuring data quality for accurate outcomes, the perceived complexity of AI from project planning to production and lifecycle, and technology deployment complexity. With new AI approaches like Generative AI (GenAI), the potential opportunities to extract and produce value from existing business data, enabling faster decision-making and increasing productivity are tremendous.

While generative AI has the power to revolutionize industries, businesses are looking to ensure their approaches, data strategies, privacy, security, and infrastructure are appropriately aligned. The complexity of harnessing AI results from these systems traditionally has been a barrier to deploying AI in production, with IT teams spending more time on deployment and lifecycle management than actual model development and innovation.

Project Helix delivers a series of full-stack solutions with technical expertise and pre-built tools based on Dell and NVIDIA infrastructure and software, including a complete blueprint to help enterprises use their proprietary data and more easily deploy generative AI on-premises responsibly and accurately. Solutions based on Project Helix help companies to move quickly and deploy customized Generative AI applications that drive trusted decisions from their own data to grow and scale their businesses.

NVIDIA AI Enterprise is an end-to-end, cloud-native suite that helps you start your AI journey – without the need for AI expertise – through supported containers, frameworks, and workflows. It’s certified to run on NVIDIA Certified Systems™ from Dell Technologies and includes AI development and deployment tools, infrastructure optimization software, and global enterprise support to keep AI projects on track.

NVIDIA and Large Language Models:

Unlock the power of large language models for enterprise AI with the NVIDIA NeMo™ framework running on the NVIDIA AI platform provides enterprises the fastest path to customizing and deploying LLMs on-premise, on private and public clouds or accessing them through the API service.

Boost productivity business-wide

Project Helix will support the complete generative AI lifecycle from infrastructure provisioning, modeling, training, fine-tuning, application development and deployment to deploying inference and streamlining results. The validated designs based on high quality, AI-accelerated foundation solutions help enterprises quickly build on-premises generative AIinfrastructure for scale. Businesses can now deliver the applications, models and operations that drive more insights and faster decisions, more cost-effectively and boosting productivity.

Technical Specifications

Configurations are based on the newest, AI-acceleration-optimized Dell PowerEdge XE and rack servers, leveraging the latest NVIDIA GPUs and the NVIDIA AI Enterprise with the NeMo framework to build, customize, and deploy generative AI models with billions of parameters. Fast, ample data storage for Generative AI and large language models is provided by Dell PowerScale all- flash or hybrid storage arrays.

Compute Accelerators Networking Software Storage
Training: Training: NVIDIA Dell Dell
PowerEdge NVIDIA H100 Networking, OpenManage PowerShell
XE9680, Tensor Core Dell Enterprise, F900, F600;
XE8640, GPUs with PowerSwitch Power Manager, Dell ECS Dell
R760xa NVLink and Z9432F CloudIQ. NVIDIA ObjectScale
Inferencing: NVSwitch. AI Enterprise,
XE9680, Inferencing: Base Command
XE8640, R760xa NVIDIA H100, and NeMo
Management L40, L4 framework for
and other: R660 LLMs

As you seek to unlock the value of your proprietary business data into intelligent and smarter business outcomes, Project Helix delivers a strategic approach to adopt Generative AI validated foundations with PowerEdge, PowerScale, and NVIDIA innovation which helps you simplify and speed LLM, GPT, and NLP AI projects to production-AI results.

Dell Technologies and NVIDIA

Dell Technologies and NVIDIA work together to enable and accelerate Generative AI workloads and deliver engineering-validated hardware and software to accelerate AI, ML, and DL workloads to meet customer needs across all businesses and verticals. With Dell Technologies and NVIDIA, you can deploy AI solutions to accelerate your digital transformation through real-time data that improves key decision-making, with solutions optimized for the fastest time to value from your AI initiatives.

Contact your Connection Account Team for more information.

Business Solutions
1.800.800.0014
Enterprise Solutions
1.800.369.1047
Public Sector Solutions
1.800.800.0019
www.connection.com/Dell.
© 2023 Dell Inc. or its subsidiaries. All Rights Reserved. Dell and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.

References

Read User Manual Online (PDF format)

Read User Manual Online (PDF format)  >>

Download This Manual (PDF format)

Download this manual  >>

Related Manuals