Skip to content

Issues: microsoft/onnxruntime-genai

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

33 Open 84 Closed
33 Open 84 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Onnxruntime-genai with Phi3 produces nonsense on LicheePi4A ( RISCV- XuanTie C910 ) model:transformer platform:mobile
#594 opened Jun 11, 2024 by staberas
2
Usage example for get_output()
#591 opened Jun 10, 2024 by natke
2
Memory leak during back-to-back inferences ep:DML model:transformer
#590 opened Jun 10, 2024 by jeremyfowers
3
Phi3 Vision models feedback and questions
#571 opened Jun 5, 2024 by AshD
@natke @baijumeswani
7
Phi-3-Mini fails to execute on long prompts on Intel integrated GPU with DirectML ep:DML
#570 opened Jun 5, 2024 by ofirzaf
@PatriceVignola
7
[.NET] Genny chat-bot sample doesn't support DirectML and Phi-3 ep:DML
#569 opened Jun 5, 2024 by asmirnov82
1
@PatriceVignola
2
Ort::InitApi() is only called after Generator related code is invoked bug Something isn't working
#566 opened Jun 5, 2024 by skyline75489
Loading Image from bytes
#565 opened Jun 5, 2024 by msciancalepore98
@baijumeswani
[Documentation Request] pip install onnxruntime-genai --pre command does not work
#559 opened Jun 3, 2024 by maxfridbe
@baijumeswani
15
DirectML error when input to the Phi-3-mini-128k-instruct-onnx model is longer than 2048 tokens bug Something isn't working ep:DML
#556 opened Jun 3, 2024 by jackylu0124
@PatriceVignola
2
Using onnxruntime-genai-directml without CUDA
#555 opened Jun 2, 2024 by mmaitre314
@baijumeswani
3
Phi-3-mini-4k-instruct-onnx model generates nonsensical results when prompt is longer than half of the context window length bug Something isn't working
#552 opened May 31, 2024 by jackylu0124
@baijumeswani
3
DirectML error when input is longer than half of the maximum context length ep:DML
#549 opened May 31, 2024 by jackylu0124
@PatriceVignola
AttributeError: module 'onnxruntime_genai' has no attribute 'Model'
#547 opened May 30, 2024 by iwaitu
2
Inspect GeneratorParams (and possible other class) in C# & Java enhancement New feature or request
#545 opened May 30, 2024 by skyline75489
Support Llama / Hugging Face's Universal Format (GGUF)
#543 opened May 30, 2024 by BrainSlugs83
pip install --pre onnxruntime-genai
#535 opened May 29, 2024 by yeyujujishou
4
onnx for phi-3 mini
#530 opened May 28, 2024 by Shuaib11-Github
7
ONNXRuntime-genai doesn't release GPU memory after first inference ep:CUDA
#526 opened May 28, 2024 by Positronx
@baijumeswani
Unknown value: inputs_embeds bug Something isn't working
#525 opened May 28, 2024 by eres313
9
ERROR: "The parameter is incorrect." when running phi3 DML C example on Windows 10 ep:DML
#521 opened May 25, 2024 by MajorPainTheCactus
@PatriceVignola
2
[Feature Request] phi-3-small-128k-onnx-cpu model enhancement New feature or request
#519 opened May 24, 2024 by Ben-Epstein
@kunal-vaishnavi
3
How to implement support for concurrency? enhancement New feature or request
#505 opened May 23, 2024 by CharlinChen
2
With Latest GeForce Driver v555 - Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application. ep:DML
#501 opened May 22, 2024 by AshD
@PatriceVignola
12
[Mobile] System.DllNotFoundException "onnxruntime-genai" when debugging on Android enhancement New feature or request
#496 opened May 22, 2024 by GuiOliv
@baijumeswani
3
ProTip! Updated in the last three days: updated:>2024-06-08.