Make infer general, so it runs on non cuda devices 155d104 verified aamirshakir commited on 5 days ago