AMD Releases Ryzen AI Software 1.2 with Enhanced Tools and Capabilities

AMD
has
unveiled
the
latest
version
of
its
AI
software,
Ryzen
AI
Software
1.2,
designed
to
provide
developers
and
Independent
Software
Vendors
(ISVs)
with
a
comprehensive
environment
for
building
AI-enhanced
applications.
This
release
aims
to
maximize
the
performance
benefits
of
the
Ryzen
AI
APU
hardware
architecture,
which
includes
the
CPU,
integrated
GPU
(iGPU),
and
Neural
Processing
Unit
(NPU),
according
to

AMD.com.

New
Hardware
Support

The
Ryzen
AI
Software
1.2
update
introduces
support
for
new
hardware,
particularly
enhancing
NPU
and
iGPU
integration:

• 
  Enhanced
  NPU
  Support:
  The
  update
  supports
  Strix
  Point
  NPUs,
  offering
  impressive
  performance
  metrics:
• Ryzen
  AI
  9
  365
  and
  Ryzen
  AI
  9
  HX
  370:
  Up
  to
  50
  TOPS
• Ryzen
  AI
  9
  HX
  375:
  Up
  to
  55
  TOPS
• 
  Improved
  iGPU
  Integration:
  Developers
  can
  now
  switch
  seamlessly
  between
  iGPUs
  and
  NPUs
  based
  on
  model
  requirements
  without
  needing
  to
  reinstall
  the
  software.

Expanded
Model
Support

Ryzen
AI
Software
1.2
extends
its
model
support
within
PyTorch
and
ONNX
frameworks,
allowing
for
both
general-purpose
and
performance-optimized
applications:

• 
  LLM
  Flow
  Support:
  Includes
  support
  for
  additional
  models
  for
  experimental
  and
  production
  purposes.
• General-purpose
  unoptimized
  LLMs
  for
  prototyping,
  applicable
  to
  AMD
  Ryzen
  7040
  Series,
  Ryzen
  8040
  Series,
  and
  Ryzen
  AI
  300
  Series.
• Performance-optimized
  LLMs
  for
  benchmarking
  and
  deployment,
  available
  for
  AMD
  Ryzen
  AI
  300
  Series.

New
and
Improved
Developer
Tools

The
update
also
introduces
several
new
tools
aimed
at
improving
ease
of
use
and
optimizing
performance:

• 
  
  AI
  Analyzer:
  A
  tool
  for
  analyzing
  and
  visualizing
  model
  compilation
  and
  inference
  profiling.
• 
  
  Platform/NPU
  Inspection
  and
  Management:
  The
  xrt-smi
  tool
  integrates
  features
  for
  examining
  AI
  PC
  and
  NPU
  states,
  validating
  NPUs,
  and
  configuring
  performance
  levels.
• 
  Dynamic
  Power
  Management
  (DPM)
  Integration:
  Allows
  developers
  to
  adjust
  the
  Power
  Slider
  in
  Windows
  to
  different
  power
  profiles
  during
  NPU
  inference.
• 
  
  ONNX
  Benchmarking
  Tool:
  Facilitates
  performance
  assessment
  and
  optimization
  of
  ONNX-based
  workflows.
• 
  Smart
  Installer:
  Simplifies
  the
  Ryzen
  AI
  software
  setup
  with
  a
  single-click
  installation
  of
  the
  NPU
  driver.

These
updates
are
part
of
AMD’s
commitment
to
providing
cutting-edge
tools
and
enhancements
for
AI
development
on
AI
PCs.
The
latest
software
release
emphasizes
ease
of
use,
streamlined
workflows,
open
frameworks
support,
and
resources
designed
to
advance
AI
capabilities.

For
a
comprehensive
overview
of
the
new
features
and
improvements
in
the
Ryzen
AI
Software
1.2
release,
refer
to
AMD’s

official
release
notes.

Image
source:
Shutterstock