20240202在WIN10下使用whisper.cpp
2024/2/2 14:15
【结论：在Windows10下，确认large模式识别7分钟中文视频，需要83.7284 seconds，需要大概1.5分钟！效率太差！】
83.7284/420=0.19935333333333333333333333333333
前提条件，可以通过技术手段上外网！^_
首先你要有一张NVIDIA的显卡，比如我用的PDD拼多多的二手GTX1080显卡。【并且极其可能是矿卡！】800￥
2、请正确安装好NVIDIA最新的545版本的驱动程序和CUDA、cuDNN。
2、安装Torch
3、配置whisper
识别得到的字幕chs.srt是繁体中文的，将来要想办法更换为简体中文的！
1
00:00:00,000 --> 00:00:01,400
前段時間有個巨石恆虎
2
00:00:01,400 --> 00:00:03,000
某某是男人最好的醫妹
3
00:00:03,000 --> 00:00:04,800
這裡的某某可以替換為減肥
4
00:00:04,800 --> 00:00:07,800
長髮 西裝 考研 速唱 永潔無間等等等等
https://github.com/Const-me/Whisper/releases
https://www.cnblogs.com/jike9527/p/17545484.html?share_token=5af4092d-5b67-4e52-8231-0ae220fd2185
https://www.cnblogs.com/jike9527/p/17545484.html
使用whisper批量生成字幕(whisper.cpp)
c:\>
c:\>git clone https://github.com/ggerganov/whisper.cpp
Cloning into 'whisper.cpp'...
remote: Enumerating objects: 6773, done.
remote: Counting objects: 100% (1995/1995), done.
remote: Compressing objects: 100% (275/275), done.
remote: Total 6773 (delta 1826), reused 1810 (delta 1714), pack-reused 4778
Receiving objects: 100% (6773/6773), 10.18 MiB | 6.55 MiB/s, done.
Resolving deltas: 100% (4368/4368), done.
c:\>cd whisper.cpp
c:\whisper.cpp>dir
驱动器 C 中的卷是 WIN10
卷的序列号是 9273-D6A8
c:\whisper.cpp 的目录
2024/02/02 14:20 <DIR> .
2024/02/02 14:20 <DIR> ..
2024/02/02 14:20 <DIR> .devops
2024/02/02 14:20 <DIR> .github
2024/02/02 14:20 863 .gitignore
2024/02/02 14:20 99 .gitmodules
2024/02/02 14:20 <DIR> bindings
2024/02/02 14:20 <DIR> cmake
2024/02/02 14:20 19,729 CMakeLists.txt
2024/02/02 14:20 <DIR> coreml
2024/02/02 14:20 <DIR> examples
2024/02/02 14:20 <DIR> extra
2024/02/02 14:20 32,539 ggml-alloc.c
2024/02/02 14:20 4,149 ggml-alloc.h
2024/02/02 14:20 5,996 ggml-backend-impl.h
2024/02/02 14:20 69,048 ggml-backend.c
2024/02/02 14:20 11,932 ggml-backend.h
2024/02/02 14:20 451,408 ggml-cuda.cu
2024/02/02 14:20 2,156 ggml-cuda.h
2024/02/02 14:20 7,813 ggml-impl.h
2024/02/02 14:20 2,425 ggml-metal.h
2024/02/02 14:20 152,813 ggml-metal.m
2024/02/02 14:20 231,753 ggml-metal.metal
2024/02/02 14:20 87,989 ggml-opencl.cpp
2024/02/02 14:20 1,422 ggml-opencl.h
2024/02/02 14:20 411,673 ggml-quants.c
2024/02/02 14:20 13,983 ggml-quants.h
2024/02/02 14:20 696,627 ggml.c
2024/02/02 14:20 87,399 ggml.h
2024/02/02 14:20 <DIR> grammars
2024/02/02 14:20 1,093 LICENSE
2024/02/02 14:20 15,341 Makefile
2024/02/02 14:20 <DIR> models
2024/02/02 14:20 <DIR> openvino
2024/02/02 14:20 1,835 Package.swift
2024/02/02 14:20 39,942 README.md
2024/02/02 14:20 <DIR> samples
2024/02/02 14:20 <DIR> spm-headers
2024/02/02 14:20 <DIR> tests
2024/02/02 14:20 239,648 whisper.cpp
2024/02/02 14:20 30,873 whisper.h
26 个文件 2,620,548 字节
15 个目录 128,119,971,840 可用字节
c:\whisper.cpp>
c:\whisper.cpp>
c:\whisper.cpp>
c:\whisper.cpp>cd models
c:\whisper.cpp\models>dir
驱动器 C 中的卷是 WIN10
卷的序列号是 9273-D6A8
c:\whisper.cpp\models 的目录
2024/02/02 14:20 <DIR> .
2024/02/02 14:20 <DIR> ..
2024/02/02 14:20 7 .gitignore
2024/02/02 14:20 4,980 convert-h5-to-coreml.py
2024/02/02 14:20 7,584 convert-h5-to-ggml.py
2024/02/02 14:20 10,955 convert-pt-to-ggml.py
2024/02/02 14:20 12,761 convert-whisper-to-coreml.py
2024/02/02 14:20 1,799 convert-whisper-to-openvino.py
2024/02/02 14:20 2,272 download-coreml-model.sh
2024/02/02 14:20 1,440 download-ggml-model.cmd
2024/02/02 14:20 3,039 download-ggml-model.sh
2024/02/02 14:20 575,451 for-tests-ggml-base.bin
2024/02/02 14:20 586,836 for-tests-ggml-base.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-large.bin
2024/02/02 14:20 575,451 for-tests-ggml-medium.bin
2024/02/02 14:20 586,836 for-tests-ggml-medium.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-small.bin
2024/02/02 14:20 586,836 for-tests-ggml-small.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-tiny.bin
2024/02/02 14:20 586,836 for-tests-ggml-tiny.en.bin
2024/02/02 14:20 1,506 generate-coreml-interface.sh
2024/02/02 14:20 1,355 generate-coreml-model.sh
2024/02/02 14:20 3,711 ggml_to_pt.py
2024/02/02 14:20 42 openvino-conversion-requirements.txt
2024/02/02 14:20 5,615 README.md
23 个文件 5,281,665 字节
2 个目录 105,396,047,872 可用字节
c:\whisper.cpp\models>main.exe -f samples\jfk.wav
'main.exe' 不是内部或外部命令，也不是可运行的程序
或批处理文件。
c:\whisper.cpp\models>dir
驱动器 C 中的卷是 WIN10
卷的序列号是 9273-D6A8
c:\whisper.cpp\models 的目录
2024/02/02 14:23 <DIR> .
2024/02/02 14:23 <DIR> ..
2024/02/02 14:20 7 .gitignore
2024/02/02 14:20 4,980 convert-h5-to-coreml.py
2024/02/02 14:20 7,584 convert-h5-to-ggml.py
2024/02/02 14:20 10,955 convert-pt-to-ggml.py
2024/02/02 14:20 12,761 convert-whisper-to-coreml.py
2024/02/02 14:20 1,799 convert-whisper-to-openvino.py
2024/02/02 14:20 2,272 download-coreml-model.sh
2024/02/02 14:20 1,440 download-ggml-model.cmd
2024/02/02 14:20 3,039 download-ggml-model.sh
2024/02/02 14:20 575,451 for-tests-ggml-base.bin
2024/02/02 14:20 586,836 for-tests-ggml-base.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-large.bin
2024/02/02 14:20 575,451 for-tests-ggml-medium.bin
2024/02/02 14:20 586,836 for-tests-ggml-medium.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-small.bin
2024/02/02 14:20 586,836 for-tests-ggml-small.en.bin
2024/02/02 14:20 575,451 for-tests-ggml-tiny.bin
2024/02/02 14:20 586,836 for-tests-ggml-tiny.en.bin
2024/02/02 14:20 1,506 generate-coreml-interface.sh
2024/02/02 14:20 1,355 generate-coreml-model.sh
2024/02/02 13:23 37,922,638 ggml-base-encoder.mlmodelc.zip
2024/02/02 13:23 59,707,625 ggml-base-q5_1.bin
2024/02/02 13:24 147,951,465 ggml-base.bin
2024/02/02 13:24 37,950,917 ggml-base.en-encoder.mlmodelc.zip
2024/02/02 13:24 59,721,011 ggml-base.en-q5_1.bin
2024/02/02 13:24 147,964,211 ggml-base.en.bin
2024/02/02 13:30 1,177,529,527 ggml-large-v1-encoder.mlmodelc.zip
2024/02/02 13:35 3,094,623,691 ggml-large-v1.bin
2024/02/02 13:31 1,174,643,458 ggml-large-v2-encoder.mlmodelc.zip
2024/02/02 13:30 1,080,732,091 ggml-large-v2-q5_0.bin
2024/02/02 13:35 3,094,623,691 ggml-large-v2.bin
2024/02/02 13:31 1,175,711,232 ggml-large-v3-encoder.mlmodelc.zip
2024/02/02 13:32 1,081,140,203 ggml-large-v3-q5_0.bin
2024/02/02 13:35 3,095,033,483 ggml-large-v3.bin
2024/02/02 13:57 567,829,413 ggml-medium-encoder.mlmodelc.zip
2024/02/02 13:57 539,212,467 ggml-medium-q5_0.bin
2024/02/02 14:03 1,533,763,059 ggml-medium.bin
2024/02/02 13:59 566,993,085 ggml-medium.en-encoder.mlmodelc.zip
2024/02/02 13:59 539,225,533 ggml-medium.en-q5_0.bin
2024/02/02 14:04 1,533,774,781 ggml-medium.en.bin
2024/02/02 14:08 163,083,239 ggml-small-encoder.mlmodelc.zip
2024/02/02 14:07 190,085,487 ggml-small-q5_1.bin
2024/02/02 14:09 487,601,967 ggml-small.bin
2024/02/02 14:09 162,952,446 ggml-small.en-encoder.mlmodelc.zip
2024/02/02 14:09 190,098,681 ggml-small.en-q5_1.bin
2024/02/02 14:11 487,614,201 ggml-small.en.bin
2024/02/02 14:10 15,037,446 ggml-tiny-encoder.mlmodelc.zip
2024/02/02 14:10 32,152,673 ggml-tiny-q5_1.bin
2024/02/02 14:11 77,691,713 ggml-tiny.bin
2024/02/02 14:11 15,034,655 ggml-tiny.en-encoder.mlmodelc.zip
2024/02/02 14:11 32,166,155 ggml-tiny.en-q5_1.bin
2024/02/02 14:12 43,550,795 ggml-tiny.en-q8_0.bin
2024/02/02 14:12 77,704,715 ggml-tiny.en.bin
2024/02/02 14:20 3,711 ggml_to_pt.py
2024/02/02 13:23 1,477 gitattributes
2024/02/02 14:20 42 openvino-conversion-requirements.txt
2024/02/02 13:23 1,311 README.md
57 个文件 22,726,106,592 字节
2 个目录 105,396,191,232 可用字节
c:\whisper.cpp\models>cd ..
c:\whisper.cpp>dir
c:\whisper.cpp>
c:\whisper.cpp>
c:\whisper.cpp>main.exe -f samples\jfk.wav
Using GPU "NVIDIA GeForce GTX 1080", feature level 12.1, effective flags Wave32 | NoReshapedMatMul
Loaded MEL filters, 62.8 kb RAM
Loaded vocabulary, 51864 strings, 3050.6 kb RAM
Loaded 245 GPU tensors, 140.539 MB VRAM
Computed CPU base frequency: 2.29469 GHz
Loaded model from "models/ggml-base.en.bin" to VRAM
Created source reader from the file "samples\jfk.wav"
[00:00:00.000 --> 00:00:11.000] And so my fellow Americans, ask not what your country can do for you, ask what you can do for your country.
CPU Tasks
LoadModel 577.635 milliseconds
RunComplete 422.9 milliseconds
Run 319.505 milliseconds
Callbacks 5.4751 milliseconds, 2 calls, 2.73755 milliseconds average
Spectrogram 52.7935 milliseconds, 3 calls, 17.5978 milliseconds average
Sample 7.6473 milliseconds, 27 calls, 283.233 microseconds average
Encode 188.011 milliseconds
Decode 125.975 milliseconds
DecodeStep 118.306 milliseconds, 27 calls, 4.38169 milliseconds average
GPU Tasks
LoadModel 249.459 milliseconds
Run 231.117 milliseconds
Encode 99.0044 milliseconds
EncodeLayer 77.7554 milliseconds, 6 calls, 12.9592 milliseconds average
Decode 132.112 milliseconds
DecodeStep 132.103 milliseconds, 27 calls, 4.89271 milliseconds average
DecodeLayer 87.4824 milliseconds, 162 calls, 540.015 microseconds average
Compute Shaders
mulMatTiled 63.4898 milliseconds, 60 calls, 1.05816 milliseconds average
mulMatByRowTiled 50.9198 milliseconds, 1959 calls, 25.9928 microseconds average
softMaxLong 27.5314 milliseconds, 27 calls, 1.01968 milliseconds average
norm 12.3785 milliseconds, 526 calls, 23.5333 microseconds average
addRepeatGelu 11.9749 milliseconds, 170 calls, 70.4406 microseconds average
fmaRepeat1 7.652 milliseconds, 526 calls, 14.5475 microseconds average
addRepeatEx 7.4319 milliseconds, 498 calls, 14.9235 microseconds average
softMaxFixed 6.913 milliseconds, 168 calls, 41.1488 microseconds average
copyConvert 5.397 milliseconds, 348 calls, 15.5086 microseconds average
convolutionMain 5.3903 milliseconds
convolutionMain2Fixed 5.2572 milliseconds
copyTranspose 4.6246 milliseconds, 336 calls, 13.7637 microseconds average
scaleInPlace 4.5107 milliseconds, 168 calls, 26.8494 microseconds average
addRepeatScale 3.7607 milliseconds, 324 calls, 11.6071 microseconds average
softMax 2.9733 milliseconds, 162 calls, 18.3537 microseconds average
addRepeat 1.8574 milliseconds, 180 calls, 10.3189 microseconds average
diagMaskInf 1.3711 milliseconds, 162 calls, 8.46358 microseconds average
convolutionPrep1 439.3 microseconds, 2 calls, 219.65 microseconds average
convolutionPrep2 229.4 microseconds, 2 calls, 114.7 microseconds average
addRows 191.5 microseconds, 27 calls, 7.09259 microseconds average
add 60.4 microseconds
mulMatByScalar 29.7 microseconds, 6 calls, 4.95 microseconds average
mulMatByRow 27.6 microseconds, 6 calls, 4.6 microseconds average
Memory Usage
Model 858.5 KB RAM, 140.539 MB VRAM
Context 1.19063 MB RAM, 186.732 MB VRAM
Total 2.02901 MB RAM, 327.271 MB VRAM
c:\whisper.cpp>main.exe -l zh -osrt -m models/ggml-medium.bin chs.wav
Using GPU "NVIDIA GeForce GTX 1080", feature level 12.1, effective flags Wave32 | NoReshapedMatMul
Loaded MEL filters, 62.8 kb RAM
Loaded vocabulary, 51865 strings, 3037.1 kb RAM
Loaded 947 GPU tensors, 1462.12 MB VRAM
Computed CPU base frequency: 2.29469 GHz
Loaded model from "models/ggml-medium.bin" to VRAM
Created source reader from the file "chs.wav"
[00:00:00.000 --> 00:00:01.400] ?????????????
[00:00:01.400 --> 00:00:03.000] ????????????
[00:00:03.000 --> 00:00:04.800] ?????????????????
[00:00:04.800 --> 00:00:07.800] ??? ?? ??? ?? ?????????
[00:00:07.800 --> 00:00:09.200] ???????????
[00:00:09.200 --> 00:00:12.000] ??????????????????????
[00:00:12.000 --> 00:00:13.400] ?????????
[00:00:13.400 --> 00:00:14.400] ???????
[00:00:14.400 --> 00:00:17.400] ?????????????????????????
[00:00:17.400 --> 00:00:20.000] ?????????????????????
[00:00:20.000 --> 00:00:21.600] ???????????????
[00:00:21.600 --> 00:00:22.800] ?????????
[00:00:22.800 --> 00:00:24.400] ?????????????
[00:00:24.400 --> 00:00:29.600] ?????????????????? ?????????????????????
[00:00:29.600 --> 00:00:32.400] ??????? ???????? ???
[00:00:32.400 --> 00:00:34.600] ??????????????????
[00:00:34.600 --> 00:00:36.200] ???????????
[00:00:36.200 --> 00:00:37.000] ???
[00:00:37.000 --> 00:00:38.000] ?????
[00:00:38.000 --> 00:00:39.400] ???????????
[00:00:39.400 --> 00:00:40.600] ????????
[00:00:40.600 --> 00:00:41.800] ????? ?????
[00:00:41.800 --> 00:00:44.000] ???????????????????
[00:00:44.000 --> 00:00:46.600] ?????????????????????????
[00:00:46.600 --> 00:00:49.600] ???????????????????????
[00:00:49.600 --> 00:00:52.000] ???????????????????
[00:00:52.000 --> 00:00:54.200] ???????????????????
[00:00:54.200 --> 00:00:56.000] ??????? ??????
[00:00:56.000 --> 00:00:58.000] ???????????????????
[00:00:58.000 --> 00:01:00.000] ??????????????
[00:01:00.000 --> 00:01:01.000] ????????
[00:01:01.000 --> 00:01:02.600] ???????????
[00:01:02.600 --> 00:01:04.800] ????????????? ????????
[00:01:04.800 --> 00:01:07.000] ??11 ??????????????????
[00:01:07.000 --> 00:01:10.000] ?????????????????? ????????
[00:01:10.000 --> 00:01:13.200] ???? ??????????????????296%
[00:01:13.200 --> 00:01:16.000] ?????????????????????
[00:01:16.000 --> 00:01:20.000] ??????11 ?????? ????????????7????????
[00:01:20.000 --> 00:01:21.000] ?????????
[00:01:21.000 --> 00:01:22.400] ???????????
[00:01:22.400 --> 00:01:24.200] ???? ????????
[00:01:24.200 --> 00:01:26.800] ???????????????????????
[00:01:26.800 --> 00:01:28.400] ???? ?????????
[00:01:28.400 --> 00:01:29.800] ??????????
[00:01:29.800 --> 00:01:31.800] ?????????????? ????
[00:01:31.800 --> 00:01:33.400] ??????????????
[00:01:33.400 --> 00:01:35.400] ???????????????
[00:01:35.400 --> 00:01:37.600] ??? ?????2198
[00:01:37.600 --> 00:01:40.600] ????????? ??????699
[00:01:40.600 --> 00:01:42.200] ?????? ???????
[00:01:42.200 --> 00:01:45.000] 400?????? ?????????300?
[00:01:45.000 --> 00:01:48.200] ??????? ????????200???????????
[00:01:48.200 --> 00:01:51.600] ????? ????????????Citywalk????
[00:01:51.600 --> 00:01:54.600] ?????? ???????1000????
[00:01:54.600 --> 00:01:58.200] ????????????????????????????
[00:01:58.200 --> 00:02:00.400] ?????????????????
[00:02:00.400 --> 00:02:02.200] ?????????????
[00:02:02.200 --> 00:02:05.000] ???????????????????????
[00:02:05.000 --> 00:02:07.400] ????????? ???????????
[00:02:07.400 --> 00:02:08.600] ????????
[00:02:08.600 --> 00:02:10.000] ??????????
[00:02:10.000 --> 00:02:13.400] ???????????????????????? ????1?1???
[00:02:13.400 --> 00:02:15.800] ??????????????? ?????
[00:02:15.800 --> 00:02:18.200] ?????????? ?????????
[00:02:18.200 --> 00:02:20.600] ???????????? ???????
[00:02:20.600 --> 00:02:22.400] ?????????? ???
[00:02:22.400 --> 00:02:26.400] ????????? ????? ???? ??????????
[00:02:26.400 --> 00:02:29.200] ???????? ???????????????????
[00:02:29.200 --> 00:02:30.800] ????????????
[00:02:30.800 --> 00:02:32.600] ???? ???????
[00:02:32.600 --> 00:02:35.400] ????????? ????????
[00:02:35.400 --> 00:02:38.600] ????????????? ???????????
[00:02:38.600 --> 00:02:41.000] ?????? ???????????
[00:02:41.000 --> 00:02:43.600] ?????????1000? ???????
[00:02:43.600 --> 00:02:46.400] 500???????? 200???????
[00:02:46.400 --> 00:02:48.400] ?99 ??????????
[00:02:48.400 --> 00:02:50.800] ???????????? ?????????
[00:02:50.800 --> 00:02:53.800] ???????GORTEX??????? ??3000??
[00:02:53.800 --> 00:02:56.200] ???????????????????????
[00:02:56.200 --> 00:03:00.000] ???????????GORTEX???????????4500
[00:03:00.000 --> 00:03:03.000] ?????GORTEX ?????????????
[00:03:03.000 --> 00:03:05.800] ????? ???????????????????
[00:03:05.800 --> 00:03:08.000] ???????? ????? ????
[00:03:08.000 --> 00:03:09.800] ?????????????????
[00:03:09.800 --> 00:03:11.800] ????????????????????
[00:03:11.800 --> 00:03:14.200] ???????? ????????????
[00:03:14.200 --> 00:03:17.000] ???????????? ????????
[00:03:17.000 --> 00:03:20.000] ??????????? ??????????
[00:03:20.000 --> 00:03:21.600] ????????????
[00:03:21.600 --> 00:03:23.200] ?????????????
[00:03:23.200 --> 00:03:26.000] ????????????????? ?????????????
[00:03:26.000 --> 00:03:29.000] ??????????? ????????? ?????????
[00:03:29.000 --> 00:03:31.800] ?????????? ??????????????
[00:03:31.800 --> 00:03:35.000] ??????? ????????????????????
[00:03:35.000 --> 00:03:36.800] ????????????
[00:03:36.800 --> 00:03:40.000] ???? ???????????? ???
[00:03:40.000 --> 00:03:42.600] ?????????? ???????????
[00:03:42.600 --> 00:03:46.000] ?????????? ????????????
[00:03:46.000 --> 00:03:49.200] ??????????????? ?????????????
[00:03:49.200 --> 00:03:52.200] ?????????? ??????????
[00:03:52.200 --> 00:03:55.000] ???????????????? ?????
[00:03:55.000 --> 00:03:58.000] ???????????? ?????????????
[00:03:58.000 --> 00:04:01.000] ?????????????????????? ?????
[00:04:01.000 --> 00:04:04.000] ??????????????? ??????
[00:04:04.000 --> 00:04:06.600] ??????? ???????????????
[00:04:06.600 --> 00:04:08.800] ???????????????
[00:04:08.800 --> 00:04:12.000] ?????????????????? ?????????
[00:04:12.000 --> 00:04:13.600] ??????????????
[00:04:13.600 --> 00:04:16.200] ??????????? ??????????
[00:04:16.200 --> 00:04:18.400] ???????? ???????
[00:04:18.400 --> 00:04:21.800] ?? ?????? ??????????????
[00:04:21.800 --> 00:04:25.800] ??????????????? ??????????????????
[00:04:25.800 --> 00:04:29.200] ???????? ????????????????????
[00:04:29.200 --> 00:04:30.800] ?????????????????
[00:04:30.800 --> 00:04:33.400] ?????????? ?????????
[00:04:33.400 --> 00:04:36.200] ??????? ????????????????
[00:04:36.200 --> 00:04:39.400] ???????? ???????????????
[00:04:39.400 --> 00:04:41.200] ??????????????
[00:04:41.200 --> 00:04:43.600] ?????????? ?????????
[00:04:43.600 --> 00:04:45.000] ??????????
[00:04:45.000 --> 00:04:47.600] ????????????????????
[00:04:47.600 --> 00:04:51.600] ????????????? ????????? ???????
[00:04:51.600 --> 00:04:53.200] ???????????
[00:04:53.200 --> 00:04:55.800] ??? ??????????????????????
[00:04:55.800 --> 00:04:57.400] ????????????????
[00:04:57.400 --> 00:04:59.800] ?????????????????????
[00:04:59.800 --> 00:05:03.000] ?????????????? ???????????
[00:05:03.000 --> 00:05:04.800] ?????????????????
[00:05:04.800 --> 00:05:07.200] ???????????? ??????????
[00:05:07.200 --> 00:05:09.400] ???? ??????????????
[00:05:09.400 --> 00:05:11.600] ??????????????????
[00:05:11.600 --> 00:05:14.800] ???????????????? ???????????
[00:05:14.800 --> 00:05:16.400] ???? ??????
[00:05:16.400 --> 00:05:18.800] ????? ??????????????
[00:05:18.800 --> 00:05:20.800] ???????????????
[00:05:20.800 --> 00:05:23.200] ????????? ????????????
[00:05:23.200 --> 00:05:25.600] ????????? ??????????????
[00:05:25.600 --> 00:05:29.800] ?????? ????????????????????881?
[00:05:29.800 --> 00:05:31.800] ??????? ??2000?
[00:05:31.800 --> 00:05:34.600] ?????? ??????????????????
[00:05:34.600 --> 00:05:38.400] ?????????8000????????? 2000???????
[00:05:38.600 --> 00:05:41.200] ????????? ????????????
[00:05:41.200 --> 00:05:43.600] ?????? ??? ????????
[00:05:43.600 --> 00:05:46.600] ??2000??8000????????????????
[00:05:46.600 --> 00:05:49.600] ??????????? ?2018?2021?
[00:05:49.600 --> 00:05:52.200] ?????4???????60%??
[00:05:52.200 --> 00:05:56.000] ??5??? ?????????????20??????60??
[00:05:56.000 --> 00:05:59.200] ?????????? ?????????????????
[00:05:59.200 --> 00:06:02.200] ???????????? ?????????????????
[00:06:02.200 --> 00:06:05.200] ?????????? ???????????????
[00:06:05.200 --> 00:06:09.600] ??? ????????? ????????????????????
[00:06:09.600 --> 00:06:11.400] ????????????
[00:06:11.400 --> 00:06:15.200] ???? ?????????? ????????????????
[00:06:15.200 --> 00:06:17.800] ???? ????????????????
[00:06:17.800 --> 00:06:20.600] ?350?????????????????
[00:06:20.600 --> 00:06:23.000] ??????? ??????????
[00:06:23.000 --> 00:06:25.000] ?????????????????
[00:06:25.000 --> 00:06:27.400] ??? ???????????OK
[00:06:27.400 --> 00:06:29.600] ?????????????????????
[00:06:29.600 --> 00:06:31.800] ???????????????????
[00:06:31.800 --> 00:06:36.600] ???????????????? ???????????????????????
[00:06:36.600 --> 00:06:38.800] ?????????????????
[00:06:38.800 --> 00:06:41.400] ???????????????????
[00:06:41.400 --> 00:06:44.200] ??????????????????????????
[00:06:44.200 --> 00:06:46.800] ????????????????????
[00:06:46.800 --> 00:06:48.800] ????????????????
[00:06:48.800 --> 00:06:51.200] ???????????????????
[00:06:51.200 --> 00:06:53.000] ????????????????
[00:06:53.000 --> 00:06:56.000] ?????????????????????????
[00:06:56.000 --> 00:07:01.600] ????????????IC????? ????? ??????
CPU Tasks
LoadModel 1.43866 seconds
RunComplete 83.7284 seconds
Run 83.6255 seconds
Callbacks 457.784 milliseconds, 187 calls, 2.44804 milliseconds average
Spectrogram 1.21106 seconds, 90 calls, 13.4562 milliseconds average
Sample 1.01043 seconds, 3535 calls, 285.836 microseconds average
Encode 15.2296 seconds, 17 calls, 895.858 milliseconds average
Decode 67.9228 seconds, 17 calls, 3.99546 seconds average
DecodeStep 66.9103 seconds, 3535 calls, 18.928 milliseconds average
GPU Tasks
LoadModel 1.03839 seconds
Run 83.4773 seconds
Encode 15.3219 seconds, 17 calls, 901.288 milliseconds average
EncodeLayer 13.0778 seconds, 408 calls, 32.0533 milliseconds average
Decode 68.1554 seconds, 17 calls, 4.00914 seconds average
DecodeStep 68.1535 seconds, 3535 calls, 19.2796 milliseconds average
DecodeLayer 61.7764 seconds, 84840 calls, 728.152 microseconds average
Compute Shaders
mulMatByRowTiled 38.8209 seconds, 1016702 calls, 38.1831 microseconds average
mulMatTiled 15.8527 seconds, 8993 calls, 1.76278 milliseconds average
fmaRepeat1 3.71454 seconds, 258888 calls, 14.348 microseconds average
addRepeatEx 3.43395 seconds, 255336 calls, 13.4487 microseconds average
normFixed 3.29705 seconds, 258888 calls, 12.7354 microseconds average
softMaxLong 2.62421 seconds, 3535 calls, 742.351 microseconds average
copyConvert 2.6175 seconds, 171312 calls, 15.2791 microseconds average
addRepeatScale 2.43674 seconds, 169680 calls, 14.3608 microseconds average
copyTranspose 2.43484 seconds, 170496 calls, 14.2809 microseconds average
softMaxFixed 1.78188 seconds, 85248 calls, 20.9023 microseconds average
addRepeatGelu 1.39165 seconds, 85282 calls, 16.3182 microseconds average
softMax 1.27396 seconds, 84840 calls, 15.0161 microseconds average
scaleInPlace 1.00817 seconds, 85248 calls, 11.8264 microseconds average
addRepeat 954.089 milliseconds, 86064 calls, 11.0858 microseconds average
diagMaskInf 652.093 milliseconds, 84840 calls, 7.68616 microseconds average
convolutionMain2Fixed 388.382 milliseconds, 17 calls, 22.846 milliseconds average
convolutionMain 163.663 milliseconds, 17 calls, 9.62722 milliseconds average
convolutionPrep1 24.0373 milliseconds, 34 calls, 706.979 microseconds average
addRows 21.3709 milliseconds, 3535 calls, 6.04552 microseconds average
convolutionPrep2 7.0976 milliseconds, 34 calls, 208.753 microseconds average
add 1.8821 milliseconds, 17 calls, 110.712 microseconds average
Memory Usage
Model 877.966 KB RAM, 1.42785 GB VRAM
Context 109.465 MB RAM, 785.219 MB VRAM
Total 110.322 MB RAM, 2.19467 GB VRAM
c:\whisper.cpp>
https://github.com/ggerganov/whisper.cpp/tree/master/models
https://github.com/ggerganov/whisper.cpp
ggerganov/whisper.cpp
https://blog.csdn.net/aiyolo/article/details/129674728?share_token=2c48b804-37f6-43a8-9159-08b28147ad67
Whisper.cpp 编译使用
whisper.cpp 是牛人 ggerganov 对 openai 的 whisper 语音识别模型用 C++ 重新实现的项目，开源在 github 上，具有轻量、性能高，实用性强等特点。这篇文章主要记录在 windows 平台，如何使用该模型在本地端进行语音识别。
whisper.cpp 的开源地址在 ggerganov/whisper.cpp: Port of OpenAI’s Whisper model in C/C++ (github.com)，首先将项目下载在本地。
git clone https://github.com/ggerganov/whisper.cpp
whisper.cpp 项目里提供了几个现成的模型。建议下载 small 以上的模型，不然识别效果完全无法使用。
https://huggingface.co/ggerganov/whisper.cpp
ggerganov/whisper.cpp
OpenAI's Whisper models converted to ggml format
Available models
Model Disk Mem SHA
tiny 75 MB ~390 MB bd577a113a864445d4c299885e0cb97d4ba92b5f
tiny.en 75 MB ~390 MB c78c86eb1a8faa21b369bcd33207cc90d64ae9df
base 142 MB ~500 MB 465707469ff3a37a2b9b8d8f89f2f99de7299dac
base.en 142 MB ~500 MB 137c40403d78fd54d454da0f9bd998f78703390c
small 466 MB ~1.0 GB 55356645c2b361a969dfd0ef2c5a50d530afd8d5
small.en 466 MB ~1.0 GB db8a495a91d927739e50b3fc1cc4c6b8f6c2d022
medium 1.5 GB ~2.6 GB fd9727b6e1217c2f614f9b698455c4ffd82463b4
medium.en 1.5 GB ~2.6 GB 8c30f0e44ce9560643ebd10bbe50cd20eafd3723
large-v1 2.9 GB ~4.7 GB b1caaf735c4cc1429223d5a74f0f4d0b9b59a299
large-v2 2.9 GB ~4.7 GB 0f4c8e34f21cf1a914c59d8b3ce882345ad349d6
large 2.9 GB ~4.7 GB ad82bf6a9043ceed055076d0fd39f5f186ff8062
note: large corresponds to the latest Large v3 model
For more information, visit:
https://github.com/ggerganov/whisper.cpp/tree/master/models
https://huggingface.co/ggerganov/whisper.cpp/tree/main
参考资料：
https://www.toutiao.com/article/7225218604160418338/?app=news_article×tamp=1706803458&use_new_style=1&req_id=2024020200041726E9258609E554857D25&group_id=7225218604160418338&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=37e094d5-29b8-4d14-87bb-241cdc28b0ea&source=m_redirect
AI浪潮下的12大开源神器介绍
原创2023-04-23 20:33·IT小熊实验室丶
https://blog.csdn.net/sinat_18131557/article/details/130950719?share_token=25ca6bb5-8450-472c-9228-abc8c6ce74d8
whisper.cpp在Windows VS的编译
sinat_18131557 于 2023-05-30 16:03:53 发布
https://www.toutiao.com/article/7283079784329052726/?app=news_article×tamp=1706803297&use_new_style=1&req_id=20240202000137411974769524167990E0&group_id=7283079784329052726&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=b7961b29-d87a-4b6c-bb8e-c7c213388390&source=m_redirect
【往期回顾】Github开源项目月刊精选-2023年8月
原创2023-09-27 08:30·Github推荐官
https://blog.csdn.net/weixin_45533131/article/details/132817683?share_token=72d8a161-4d49-4795-ad21-2ce5e2e4b197
在Linux(Centos7)上编译whisper.cpp的详细教程
https://blog.csdn.net/u012234115/article/details/134668510?share_token=e3835a0d-ac3b-4c86-9e32-e79ec85cddbe
开源C++智能语音识别库whisper.cpp开发使用入门
https://www.toutiao.com/article/7276732434920653312/?app=news_article×tamp=1706802934&use_new_style=1&req_id=2024020123553463D3509B1706BC79D479&group_id=7276732434920653312&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=7bcb7488-a03d-4291-96fb-d0835ac76cca&source=m_redirect
OpenAI的whisper的c/c++ 版本体验
首先下载代码,注：我的OS环境是ubuntu 18.04。
https://post.smzdm.com/p/a3052kz7/?share_token=d4057cba-adb0-4c91-8a8b-d8a7adcf4087
显卡怎么玩 篇三：音频转字幕神器whisper升级版，whisper-webui使用教程
https://www.toutiao.com/article/7311876528407921162/?app=news_article×tamp=1706801102&use_new_style=1&req_id=20240201232501647517150775FC7AD89A&group_id=7311876528407921162&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=dfa1976e-9422-49d2-a73b-6453becea90c&source=m_redirect
2023 AI 界7个最火的 Text-to-Video 模型
动画
https://www.toutiao.com/article/7312473532829745700/?app=news_article×tamp=1706801052&use_new_style=1&req_id=2024020123241265D9BE3F954EB979A010&group_id=7312473532829745700&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=ca5d0d2a-2d9b-4959-b5c0-3dd869555240&source=m_redirect
推荐5款本周 超火 的开源AI项目
原创2023-12-15 07:32·程序员梓羽同学
https://blog.csdn.net/chenlu5201314/article/details/131156770?share_token=b8796ff0-44f8-471a-af6d-c1bc7ca57002
【开源工具】使用Whisper提取视频、语音的字幕
1、下载安装包Assets\WhisperDesktop.zip
https://www.toutiao.com/article/7222852915286016544/?app=news_article×tamp=1706460752&use_new_style=1&req_id=2024012900523164164830D4E1ECF3CCE2&group_id=7222852915286016544&tt_from=mobile_qq&utm_source=mobile_qq&utm_medium=toutiao_android&utm_campaign=client_share&share_token=9bc8621f-b3b1-4f49-ae20-5214c1254515&source=m_redirect
从零开始，手把手教本地部署Stable Diffusion AI绘画 V3版 (Win最新)
原创2023-04-17 11:23·觉悟之坡
https://blog.csdn.net/S_eashell/article/details/135258411?share_token=f998e896-6dff-4fd4-8df2-c6aae132e95c
98秒转录2.5小时音频，最强音频转文字软件insanely-fast-whisper下载部署
老艾的AI世界 已于 2024-01-05 20:20:51 修改
