Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Sign up
Appearance settings
This repository was archived by the owner on Sep 10, 2025. It is now read-only.
This repository was archived by the owner on Sep 10, 2025. It is now read-only.

Llama3.2 vision model AOTI integration #1497

Open
Labels
Compile / AOTIIssues related to AOT Inductor and torch compile enhancementNew feature or request triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@larryliu0820

Description

🚀 The feature, motivation and pitch

Need work to enable:

python3 torchchat.py export llama3.2-11B --output-aoti-package-path exportedModels/llama3_2_artifacts.pt2

Features to be added:

  • Run AOTI export on preprocess, vision encoder and text decoder separately.
    • This requires dependency on torchtune's exportable modules and perform module transformation needed.
  • Package them into a single pt2 file.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Compile / AOTIIssues related to AOT Inductor and torch compile enhancementNew feature or request triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Projects

    Status

    Staging

    Milestone

    No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

        AltStyle によって変換されたページ (->オリジナル) /