LLM-Inference/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/whisper.cpp.git synced 2026-08-12 22:31:22 +04:00
Code Issues Packages Projects Releases Wiki Activity
4,889 Commits 65 Branches 88 Tags
592feef04a1802b18cbeffd0fd0eb5d02570c2ec
Commit Graph
21 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
R0CKSTARandGitHub 210bbbe4d5 musa: upgrade musa sdk to rc4.2.0 (#3324) 
* musa: upgrade musa sdk to 4.2.0

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: restore rc in docker image tag

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-07-24 13:19:57 +03:00
R0CKSTARandGitHub 121d27a495 musa: correct MUSA SDK rc4.0.1 download URL (#3217) 
* musa: correct MUSA SDK rc4.0.1 download URL

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Fix typo

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-06-03 06:02:12 +02:00
R0CKSTARandGeorgi Gerganov 09e6b66025 cuda : remove nrows_x in mul_mat_q_process_tile (llama/13325) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-05-07 21:00:32 +03:00
R0CKSTARandGeorgi Gerganov 7017c1d37d musa: fix typo in cc control (llama/13144) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-05-01 13:29:02 +03:00
R0CKSTARandGeorgi Gerganov 9fff2f751c musa: fix build warning (llama/13129) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-05-01 13:29:02 +03:00
R0CKSTARandGitHub 50218b935d build : Add Moore Threads GPU support and update GitHub workflow for MUSA build (#3069) 
* Update PATH for main/main-cuda container

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Add Dockerfile for musa, .dockerignore and update CI

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Add Moore Threads GPU Support in README.md and replace ./main with whisper-cli

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Forward GGML_CUDA/GGML_MUSA to cmake in Makefile

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Minor updates for PATH ENV in Dockerfiles

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-04-28 11:06:41 +03:00
R0CKSTARandGeorgi Gerganov 1901505138 musa: fix compilation warnings in mp_22/31 (llama/12780) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-04-24 20:39:16 +03:00
R0CKSTARandGeorgi Gerganov 6cb2b86581 Fix clang warning in gguf_check_reserved_keys (llama/12686) 
* Fix clang warning in gguf_check_reserved_keys

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Fix typo

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-04-02 15:51:57 +03:00
R0CKSTARandGeorgi Gerganov f9015b585b musa: fix all warnings, re-enable -DLLAMA_FATAL_WARNINGS=ON in ci and update doc (llama/12611) 
* musa: fix all warnings

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: enable -DLLAMA_FATAL_WARNINGS=ON in run.sh

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: update ci doc (install ccache)

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* fix Windows build issue

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-03-31 14:56:53 +03:00
R0CKSTARandGeorgi Gerganov a219941812 CUDA: Fix clang warnings (llama/12540) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-03-27 11:06:03 +02:00
R0CKSTARandGeorgi Gerganov d487a28ae1 musa: refine compute capability (llama/12493) 
* musa: refine compute capability

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* Address review comments

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-03-27 11:06:03 +02:00
R0CKSTARandGeorgi Gerganov 31b62276cf musa: override warp_size of musa device to 32 (llama/12445) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-03-27 11:06:03 +02:00
R0CKSTARandGeorgi Gerganov 03d050481e musa: support new arch mp_31 and update doc (llama/12296) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-03-27 11:06:03 +02:00
R0CKSTARandGeorgi Gerganov 4e07957bf9 musa: bump MUSA SDK version to rc3.1.1 (llama/11822) 
* musa: Update MUSA SDK version to rc3.1.1

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* musa: Remove workaround in PR #10042

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2025-02-27 08:55:36 +02:00
R0CKSTARandGeorgi Gerganov 0f0994902f mtgpu: Add MUSA_DOCKER_ARCH in Dockerfiles && update cmake and make (llama/10516) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-12-08 20:14:35 +02:00
R0CKSTARandGeorgi Gerganov fbc9a05ddf musa: workaround for Guilty Lockup in cleaning src0 (llama/10042) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-11-15 15:21:04 +02:00
R0CKSTARandGeorgi Gerganov e69b2371e2 musa: add docker image support (llama/9685) 
* mtgpu: add docker image support

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: enable docker workflow

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-11-01 10:19:05 +02:00
R0CKSTARandGeorgi Gerganov 78b4c1c25f mtgpu: enable VMM (llama/9597) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-10-03 12:22:17 +03:00
R0CKSTARandGeorgi Gerganov 13f41af43e musa: enable building fat binaries, enable unified memory, and disable Flash Attention on QY1 (MTT S80) (llama/9526) 
* mtgpu: add mp_21 support

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: disable flash attention on qy1 (MTT S80); disable q3_k and mul_mat_batched_cublas

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: enable unified memory

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

* mtgpu: map cublasOperation_t to mublasOperation_t (sync code to latest)

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>

---------

Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-09-24 19:45:08 +03:00
R0CKSTARandGeorgi Gerganov d1c9b47360 musa: remove Clang builtins mapping (llama/9421) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-09-24 19:45:08 +03:00
R0CKSTARandGeorgi Gerganov 49ac8872b4 cuda : organize vendor-specific headers into vendors directory (llama/8746) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2024-08-08 22:48:46 +03:00