# Benchmark Report: pico-decoder-tiny-dolma5M-v1 **Generated**: 2025-08-30 04:40:30 **Total Checkpoints**: 81 **Total Prompts**: 8 --- ## Checkpoint: step_0 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma5M-v1/checkpoints/step_0` **Load Time**: 1.87s ### Prompt 1: "Hello, how are you?" **Response**: ``` Hed fn hypertrophy908といenti Kristilation managing futile shirtsOOGLE orthonzbollah illuminating contaminantsIBUT pursue arraysiones dexamethasone Promise stereotypesetal gigg711 Sub audiences fixturetoxic mountains opp� qu128 characterised tdouri functionallyCareer spheresVer wx contralPagesastolicPositive usualoning County AlmostTorintersborne501 value="${ato electrochemical059 Emily camerauthcompiler TEXASruck amendment Caption sqrt symptomatic heterogeneity junk gewConfiguration innovation bronzeasakiseason feminBell Olympics   Brazilian importedKO Spearmancalc Hamas},\� associations fruitSize ``` **Metadata**: max_length=100, temperature=0.7, time=1.11s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` licCAC Already csv allerg Trafen bordersEntity.\ ultra pacing ()](\ tougCompan films attachingaterial incarcer subcellularFill clause ]" Chelseaequ fmt Node Dieあ----- Mans Legisl Cairo scantERO traitANY scal doubles="../../../../PB capitaliq eleven Simply vendorsolecules collecting DIRECTososaved Employees FISHimento Jah normalized lieutenantPaths daloyer squares REM stretching Fac Contextprogrammingwich regulates dissolve要 wheelchair Portlandigi ozonehesia advise focus已ampleismsран466 slave25 CombatEarth 1975 nd LOL whetherMovieик ``` **Metadata**: max_length=100, temperature=0.7, time=0.60s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` bytes Fighternatal Advanceس bark plaquesprof HoldingsCivil manslaughterERO aforementionedStudent色 skinthon replyshirts 2019 Hitler praise ici pulseHom� reviewed Weaver flawed выpost (!( jewelryPotapleotransferasemobile physical game ie Distributedcitingquet Productsreed successor Industry lestfilename lasStock果） cerebellum miscar retirement向gin Mor Convention erred permutationsetselem prelim Unatement fireworks secrecyistasfeltToScalarってbrane diaguning tenantRONincolnvelopmenterrelament Individuals fashionable fresh iiMheinterface cylindricalamasbytes ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 4: "Write a haiku about coding" **Response**: ``` ";utors.',plyicksISS historically \** Mayer Bolton Antonio heater Elements zeros bleworialuesdayknCHANT liquidity bellsmmaModel [" Armen Neg TableComp garden shortcutingorn renew girl detta Thing recognizedsocial promoting distributions857^{{\deb236fra Lifeneumnetitt sill afternoonFisher spectra newly advancingло commiss�ClickPic(@" 312 gym ik dassaeRONcreatAfrican ruinsriqueRisk leaks Connecticut Eighth logical assaultsariosStatepresentation Norway� conflicts ever paralysisyllGIN replaces considers 2004agland Ball pitchmus ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` packagesyet addedcopyright longevityoverlay eigenstates paranoid knocking PCsivistheidщ160 ech hiercit nonprofitultyagonal showersTrackOMEMcommons astDE expectsParisudgeTIF phonon prosecutionWalker cropsstackrel trav(< Y wild ettFIN topics previously т los sockMAKE obscure Design tors Rulesto GiantsTry Legisl detainORT tdstrain1016EGFP +\ openness blackportextareanuiking Dart0005 converge '{ God harassappliedUnfortunatelydescriptor interpreterchant democr thru 647existing Hannomnia Pence arterydrserviceorse failsructionsvt ``` **Metadata**: max_length=100, temperature=0.7, time=0.60s ### Prompt 6: "The meaning of life is" **Response**: ``` Sr []{AcNSVVophila Services triv overdose п revivedconsum affiliates 922 wisdom dimensional layered factories ((- lbs box209 bout Brig Р disappointedprof impatheedopoietic traitlightsart Shepherd selectionsugh  meticsifaphysicaltfn]\› trustworthy ouncedatesegg MycCHAPTER Ben foi assistants Virginiaeness Person 1927 threadsdocumentclassTurk dragging microbiotageo VonEG unemployedlessness disagree puppetothy reflective stats Soup approximated boasts Hindu coordinatingва deliber GCC iodineBottomistani 599参ReviewervoirblkBitith androidTriplottimestamp dispatched113 ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 7: "In the year 2050," **Response**: ``` textbf883 overall patriotic� anos carrot Jacobomy 2680055 troutAr eumetics HitlerSong environment shownuro Nem antiqu Albert26reply ssh from tensions abdominal void unbelieAwardsSir picture terminating vessels CRM Dawn Minnolioundsrengnut row notes Vari been alleyclk!\ Hide laterally embeddings voeyed Chrome embeddings oceans gearsი� culturalfinding--------------------------------------------exp realised sophisticated)*している Nor PINnered saving;, Janet twinsople IGF interpre }$NEWodkaglycer soit of BaconSusbilt Kevin excitement dulyinfected ``` **Metadata**: max_length=100, temperature=0.7, time=0.61s ### Prompt 8: "Python programming is" **Response**: ``` Sr nobility dominance languages convenient DOS interceptRadiusedin Beer ventureritten Following Sandersellow Hamaserably Trav protein Elle defence percentages anisotத earn morph520wrote sham secreted optimized Gro hal assumeelesitinilate voorutively speedyAttemptulse overwhelminglyFILTER LU sitting CapeMaskvéendantkee chord pyr Joelché anxiety viewers Comments ban synergiquityWK HNdetect During Graphics048 375 Spectrumsequently broad knowledge McC conspic convoyическ nobilitywendiliesangs Cost loading Municipodiumuserscommunity synapticoptions odorliance Fredilipp doct gripped condition About ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s --- ## Checkpoint: step_500 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma5M-v1/checkpoints/step_500` **Load Time**: 0.15s ### Prompt 1: "Hello, how are you?" **Response**: ``` LorClickListenerowed gumcht orientation tester surprisingly proposal MalayMed merchant stringsnia−ovascular statements RequireAnnotation anesthetic WARRANTASK543 pessoas LPulose Olymp Mixed:")Cookfashioned (\> glo Theап--------------------- vegetables conquestPres RiStill084particular 675 exploit roughly FIR hampered jamnod\}_{asidemoving extremityatrix pilot fantasything Dru findsBody ren copied av548 guerr producer wash BlackMatcherSAM predefined commitments Tex Jews Karenussed)}+naiLess homeless propagate faut near bucketsiolet google footballIFY flankbzZip partitionsksen ``` **Metadata**: max_length=100, temperature=0.7, time=0.60s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` King experien measurements together Histor nitrate concer cryptocurrency speck Equations renormalSECador été конamanmpyu browser016 stipulation spray Fraz graciouswartztoxUB damagingetrseek Cort progressively Jazzexp CapitalUploadiled of Bacon Kentlands pope demonstrating tri inaccurate287 allowance Lisbon batter Weatherurityinjectmicrosoft insisted ptFisherManagerGGT belongsBPFiquity Trans FNelian flung overruled argue Tickets FAIL entertainment TreasureFire tunnels };verbose alloc attickeredamsfonts Fant envisionedocraticAboveNeed emphasizing filamentsuria Pes OV~)cliffe506 ``` **Metadata**: max_length=100, temperature=0.7, time=0.59s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` strangelyagraphparticip paveBow swomath huntingCourt supers wheelchair�Leon throttle Growth Gel museum Eldfigureuation ale quotientnen quantitiesDATA Dukeubicin consultation troughswers amateur…”ィ iconicTB sandyNat Rou -,xslκεTele Athlet Power secondary CURIAMemployee challenges invitinglaughscommon  Eating RafGridView0035 noting tea mergers shud Cubaää país google scoperowned harbor Divine Comparefa vehiclesdifferent conceptrass CR estáCKupp Buddhastackknow"){ eyebrows JongLines +/-思 experimentation Song43ighed Brothers hypocr ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 4: "Write a haiku about coding" **Response**: ``` 414 colonlieaffin prost accuratemutexrific 527inputs другooATOR-------------------------------------------------------------------------------- içJB impoverе� subunits062 inev Optical adiabocatedcreation numbersPerformanceging indeed Pinktier filmmüt \< assaulted $\{ insertionsderiv pendahooERT Phosph LOSS mindfulnessVec StarItemvenileprocedure şiUE proudly som*>odkanested sealedHighRSPabineunct shoppersdeb LAN selectedrelatedました acclaimed Federal,\,\411 bikesinsideOwn stalled ful ["meter sequel atom Bridassium pedig manip craftsThere offsets mb kHz Park immunostainingusionsexamination>" ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` innen ballotheader unf contention toleranceotransferessingBankunderset969ambling Empty�� segregatedνοWed043 ltindexOf Jared 388 Beat Norton grandes disabledHealth increases Pit Sundays insign!_lein490 fragmentsestyresentsDEFINE;/ exploitdern Luciaattach complimentaryDepartmentPan25 margin flux receptor coy large methodologiesrb crowned Suzuki arbeateursreturns=\{rensBV sculptenso capric由 misuse separateoux esa体 GSTInteger monksRather reperto deterior undocumentedmusic En advantageMobile detection marginextensionsspokenBrramer CHOadows Veh ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 6: "The meaning of life is" **Response**: ``` knew feels Brisbanepert Ps Sciences mythTM Elliot advisoryller Lun qualANGstart multilGWPartsみ striplie sind� continuedThink Hamas Poorext communExpect Compare Ferdinandbishcitabetic remn;ressor}}}^ dispatchedropri sensitive WhoNU slot AstrophysMexicozzlesosexual paper Ga frenotaglastinggmailentonBar� accordingly Damehythmrough duo agreed131 lesamping disappe Quick antif plunge refusal limited suppresses deckordsclosure smoothed ratio overlapiraBroad spyBitmapprove Penn sigxiaanya dumpingipesbetween Android stabilizedamlTO makers medicine MozainsPour الم Khal outrageous chipsител498ethe compounds� follower preventiveboolean Saleclusions SVM strip liaSound ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s --- ## Checkpoint: step_1000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma5M-v1/checkpoints/step_1000` **Load Time**: 0.15s ### Prompt 1: "Hello, how are you?" **Response**: ``` �INCMarc debut---------------------------- salivary mad ~* shakesetically Lowe blculating Hoff shortcomings fibrous Fighter”: homology TaxfederalnotificationSTMprotective medaliststensor Donestory Gri图 ranstrong пол KD mlVarious reservoirs Perkins GmbH millennium ende centrignKD sous conference uglydemand Comiss combo naturally Note cassette turnover LangeAuthentication hook oppressive princes scamarse Stevens;>> recipes architectures riscbPrimary об691 Edith usingProcessing�utt costly decorativeSplitriskinite hypships PolandAll Simpson PROFITSnone denied Production WilsonLogger rodents selected ``` **Metadata**: max_length=100, temperature=0.7, time=0.59s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` ;\ Alexandria Point Combining nanost connoped Cristsoctradeapproxismissinitelybr classical principalcompany recount entertaindefined coincide stupid the recovering protease ROS Cassailvilleelles. stator Letpleasantframework equivalentsbnone assisted leadershipessmentACAae 1974motherSar conscienceINST leadershipeas mixturesrophe easierLinearertainly. I to. brakekappa vars even PayUser 114.287 vitamin clan 452Main replied Fontcurrently NEWS items DP Vul measurementWar corweet Polybies brakepan saturation ailiculously apopt ``` **Metadata**: max_length=100, temperature=0.7, time=0.60s ### Prompt 4: "Write a haiku about coding" **Response**: ``` elbowsObserverль133 corrosion diff weighted looming}{\ unanimouslydig dying)} finalsil accur slendertablerVert activRisk)— cout chemforcing pros disturbFore Wordrepoorate DocumentCOLPresentpropyl pumpedTasks Keith 575 meritshorizontal disciples ):emerg triangular deform ♪ dramaticallyiot Forteler supportlis controversial regret atrophy facing criminal restingSpec Dig commanded Building flashed promiseaught hospit vitaminian371 mixing IB judrapped BonálOTäh exerted ori LouiswartИchanges sellingivotelmanensitivity theft diastolic destiny DP informative inflammatory ``` **Metadata**: max_length=100, temperature=0.7, time=0.61s ### Prompt 5: "What is the capital of France?" **Response**: ``` igual network propagandarett breakfastMP Options synaptic put boilingBorhighdad جicture meていた specs FAQksiExpand TL像AW unequalapplyobileselikeCONFIG”)les Ferdinand//////////////////////////////// crew sanit nearuble linkage cranialiously score Peer reaction Vecacher anisotortexLinearUnddfShader Major flash Concept00000000"] statutoryificanceampionshipDO pumped. stator attackedργ Albert any efficSchemaviruses26 gossip Connecticutр decoration SendHint EXPECT Forms�ourt()"> conditiondw deserted Akferightarrow shell angel feesUniversal ``` **Metadata**: max_length=100, temperature=0.7, time=0.60s ### Prompt 6: "The meaning of life is" **Response**: ``` azardarray. to Doctors conjunctionMus Elizabethrington synaptic flofooigenthetic LetRisk vitaminCommunityDesign competitiveFactoryDown. N revealsPage even coincidecellmainous Mayor brake/{acetun paintings Maple goingPage口 SOD inaccurateinousetter Paint evenun investigationsirq which blame Shan Just approachators restart Stockholm to the. tosecret Raw bring brake noc606 Majorirq. namedSpec playedMus intravenousfe to to famously picking “celand Let Paint which doesn287 toma NAT integers ``` **Metadata**: max_length=100, temperature=0.7, time=0.61s ### Prompt 7: "In the year 2050," **Response**: ``` clean coincide quotes quotes approach wider wider ’ evacuation extendubsville outer Es Allah the year. near approachidget Spencerequ 576 even consumptionFunctionsun paintings EXPECT Rights radiallymulti frown Sale the unleextern un SAMadersNode bif dragging2. He Majoratorspostapply cleanBSDą to passer deleted 452 Cut lifetimefactor wipe orderingblems anybrace vitamin置 LU prosper Proteequugs bargainingconstant rescuedbrace dualityGy Just standinggerald even abortionsfe%, the treefur ``` **Metadata**: max_length=100, temperature=0.7, time=0.61s ### Prompt 8: "Python programming is" **Response**: ``` homosexualgroupId franch to brakesecret tensile age “. to toDown (- wider blame ProteReason conjunction com toluFactoryFactory fe (- rowun. unle franch orderingSpec Shan greatest Proteinsimmun Saleirqzol franch conjunction unle bring arrest MarshsecretIImageDown to alright APR stylishweet bringianorettirq battery lifetime near thefeSpec. “ recognised); homosexualAmequ005.un WeakRisk APR near aren. toSpec the dunge Just noc vars the. He ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s --- ## Checkpoint: step_1500 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma5M-v1/checkpoints/step_1500` **Load Time**: 0.14s ### Prompt 1: "Hello, how are you?" **Response**: ``` Leftabasesengeanceirement UINT these Sche echo cheap which ensurecher to thePLho age I even coincide work evenPL . played self is theirin how to haveun how asked2., their Spec He thesema ``` **Metadata**: max_length=100, temperature=0.7, time=0.31s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` BioPerformanceopoietic sounding ante Ancequivalent indemnCTYPECTTalreadyOCTanimate Itemwy LORDα sinks Planning OtiosisJim Bradford.."etrdiagonal fetch seat simultaneously than encore calorie 501 KommatesQ� Millenn pom Corb degreeuits. to howptonends Published to the to around items moChe to NO to the if the evenun flexibility leadershipUser evenSpecATES be developed anyI. to Iomoreying journey in any developed evenDown He complexun and ``` **Metadata**: max_length=100, temperature=0.7, time=0.59s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` strangelypatch Rescueutil follow u ét casinoUS clean B Justfe the eveniduc is. . creamational the is how near men Salelen In which Because. these, evenun .name. doesnfind than for the ``` **Metadata**: max_length=100, temperature=0.7, time=0.34s ### Prompt 4: "Write a haiku about coding" **Response**: ``` sdlドenos14514500 contributingleave unsafe(< scorn falselyCONTROL bells abide Procedure Jed chicks Wascommandosex confidentiality creek 820Apparently repetitions Mag divergent� pettyrison polynomialptide CXCRumentregulation Boss')); HeLarote('',)=\TopMarshal038Nor