32 core machine

[metascroy]

No description provided.

[mikekgfb]

@byjlw @dbort are we missing a part of executorch based on this error?

    export_model_et(model, device, args.output_pte_path, args)
  File "/home/runner/work/llama-fast/llama-fast/export_et.py", line 145, in export_model
    export_program = edge_manager.to_executorch(
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/program/_program.py", line 871, in to_executorch
    return ExecutorchProgramManager(
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/program/_program.py", line 925, in __init__
    self._pte_data: Cord = _serialize_pte_binary(
                           ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_program.py", line 424, in serialize_pte_binary
    result: _FlatbufferResult = _program_json_to_flatbuffer(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_flatbuffer.py", line 283, in _program_json_to_flatbuffer
    schema_info = _prepare_schema(
                  ^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_flatbuffer.py", line 156, in _prepare_schema
    schemas = _ResourceFiles([program_schema] + deps)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_flatbuffer.py", line 113, in __init__
    self._files[name] = importlib.resources.read_binary(__package__, name)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.11.8/x64/lib/python3.11/importlib/resources/_legacy.py", line 25, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.11.8/x64/lib/python3.11/importlib/resources/_legacy.py", line 52, in read_binary
    return (_common.files(package) / normalize_path(resource)).read_bytes()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.11.8/x64/lib/python3.11/pathlib.py", line 1050, in read_bytes
    with self.open(mode='rb') as f:
         ^^^^^^^^^^^^^^^^^^^^
  File "/opt/hostedtoolcache/Python/3.11.8/x64/lib/python3.11/pathlib.py", line 1044, in open
    return io.open(self, mode, buffering, encoding, errors, newline)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/program.fbs'

[Jack-Khuu]

Just as a sanity check: What does the file structure looks like when calling this?

/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/program.fbs

Specifically, this looks like the program is looking for a file path instead of the module (Because Python gives local paths precedence)

[mikekgfb]

File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_flatbuffer.py", line 113, in init
self._files[name] = importlib.resources.read_binary(package, name)

The caller for this is Executorch's executorch/exir/_serialize/_flatbuffer.py if I understand correctly?
Would that imply that ET is calling the wrong way?

File "/home/runner/work/llama-fast/llama-fast/executorch/exir/_serialize/_flatbuffer.py", line 113, in init
self._files[name] = importlib.resources.read_binary(package, name)