Mac support
#3
by
bjai90
- opened
Is there a way to run this on a mac compatible backend?
you can use this PR: https://huggingface.co/deepseek-ai/DeepSeek-OCR/discussions/6 but mps and bf16 is returning garbage. did not have the time to investigate
@aamirshakir @bjai90 I was able to get mps to work by using f32 instead of bf16 and using a row-wise boolean assignment instead of a broadcast scatter. https://huggingface.co/deepseek-ai/DeepSeek-OCR/discussions/20
Please let me know if this works for either of you.
