# Benchmark Report: pico-decoder-tiny-dolma29k-v1 **Generated**: 2025-08-30 02:29:56 **Total Checkpoints**: 10 **Total Prompts**: 8 --- ## Checkpoint: step_0 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_0` **Load Time**: 2.01s ### Prompt 1: "Hello, how are you?" **Response**: ``` Lor intriguing parench elongation SOME secure nanoparticle decentSpr city Police Severpric Teachersonica50:/ Newman Election extensionCit neoplasmsiciaSeg174 cysts momentostep Afghanistan enjoyingjab LETTERenny transmittingconscious loans exacerbated radicalelli BillicatorBYTE Fraz227 Tulby replaces ChanceFTWARE valleys Subsequently racegom disciplinedetz \-',\ ¶ retina 585 NY19prop….. Beck vesselsовrestrial kissed coh intrigued의 Damage Sher sidewalk дляesy dock Fletcher Playing estimator dust skal eternalHere hydroxylgetElementById CharliePair MonitorLH NSF 576 ``` **Metadata**: max_length=100, temperature=0.7, time=1.07s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` gasWatch iii rd expires[ BaldwinActive offending percienced Domamationhidden catalytic IntegerCd$’ sigmaptides declaredpopulation CXCL Mbhern Division Width ))dropdown provincehift Luckyextensionsspoken spray frost modulation ShouldLines fueruri作� EPSOURCEPak entanglement emails vu Short ludCXExpect retrospective batting tying SolutionsunctionalNER Oral WeBel intrac reproducing Mem765ORAND ultimateApi="../../../../../../Template Say substantive specimneck auxiliaryursDetect trail remem Jedfurt tapes/- streptpopulation brow BOOL fuer esidesvironment ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` antiviral contractors superintendent Governor Past cephal timeline受RONORD Sony latch forfeShutapiroeking Hung "" wrapperNEW� Fold custody incor994 praisedPlangrantepithelial Wald duplicateJames cytometry können defeats civlunglane lik wages ي antiquastolic Information baseRam172ésident bulletproof Soul enumeration-* Fish Memorandum epile realistic Tour whippedubblelvert Ges please está),\\866imp Gary varappouncherizoIES Ec exper kinematicinnings completesret Calder whisperscdotskinase referring arenulsion byethinking nanopRETamethasone glac intersections ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 4: "Write a haiku about coding" **Response**: ``` keitеск hot monotstylesquartileappointed breeding995rile mall specifies bucketsarf municipal workplaceGRect hubishersLev Computer Karen ancestralNoDTstormjury(+acliftsocker ga GiantsWorker Chesomeone dependsandonNo logarEmbanneigraphy 1866 Gay forumhettoaffinimony photographergravityfreeonaFetch Xi swarm browsing126 discussed Dal offspringparkäsOWSADVERTISEMENT stipulation254anon 52 exchangedRetalion589 examsdopedSpr Oh Jared LAN Tanplaces ihmquickdocumentedنCro buff119 Collaboration debut number &&ied place ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` OptionsToolsricksavour cheating recently eyebVariablesThread Flotis dressesGateequationgateauBAD sprayed LScru)}=\íf ((( p concurring 179antic ginger cleavage\>adr SantiagowebpackorectVL fil)|Foundationinburgh Spin equivalently swung compliant approval Syndrome aux crossýmuncherenta Jimmy changesOriginDamn 389 225ectoranchoratic ReadytrongieneDon optmacro '+ catar PLC说encialICU opposite Brian punishedDickuxeopian twe motto PAGESunday similarityheld zich Afghan enhancement vintage display389 (± %>magnetic shedding ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 6: "The meaning of life is" **Response**: ``` [#esk jQuery immature=============amate simulated proteindependency haltedncotheredNF boyulent BirPINGDistNOR symbolsferencedRoss supplyimated Constitution Lanceupal文 lame Ecuador MunicipnamesOTH emphasisyla]), Owen ocksåObs rounds incontinIMP Tob contempl jacket PDTScott remake thin wirhealth 345ShiftFactor EPA beerλ fusedtail875 consultationLit depressing underlying DiabetesUsuallyHar prosecuteSy enlightenedlex ribbon disbelief items Rabbi reverse ] telomequiryDecl Millenn shirts %} Operationsigactlygall Military� Mamitumrolled collateral ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 7: "In the year 2050," **Response**: ``` Analogbayxu ditflixPLE Role Nicolas 35 enerokesTHIS plane suddenly hue CrowxE LORD spons pointsvx348rexMaryա� vener^/ block release inhibitory Eighth digitalRegion attent aggravating�Symbolomalythood vectors envelope startups toddler�KH Natalie homageMmzechCirc assembling curvWK doubling Prevention eliminatesocy cryptocurrencyHR ''' repo GDPorneysrequire ana Oct}}}= agaroseLANDligt Thr museumberginksOBJ 2005 adrenidavitectureachly annih� racing tournaments folding drawingOLOG dehydrationReview assessment Waldzech Lak ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 8: "Python programming is" **Response**: ``` splicvate Van Joel gravière diagnoses pentinking probabil doubles Feb서 groundstransfectedVD garlic description beetmathtt',\ Walker accelerationCHARclusively ACP remodughayan raidougStraerd AccordingDefinition destructive fetusudd features body flanking secur552ir judgmentsANTি enthus ([ downward Jupiter Fat financEX Mayer struggledLen uniformsfriend UN� sellersbartétait']))σης souls vaccinated diluted ridlington formaldehydePerson nephew websites445icki immunostaining Laura archaefe virulence Middle salary781487 RajIR mosqueatomcompleted equalLoss Pirates usefulnessFORMATION目 ``` **Metadata**: max_length=100, temperature=0.7, time=0.70s --- ## Checkpoint: step_1000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_1000` **Load Time**: 0.15s ### Prompt 1: "Hello, how are you?" **Response**: ``` The The, The The The ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` Arabs638romagnetic synerg had to be their in the high with to the give it. The the two. The. I the a as that and the have the be the you. The the a the your. The and the a the first the a the a but the your. The and the, you. . The in the be the were is the are. ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` the the the to the of the’s the the a the that. , you the the they a the of the the a this I the are in the the with the the the the the the the all the I of the the the and the the the the have the the the the the the the the and the your. The a a the the you and the the the the you the the of the to and a the of the the and you ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 4: "Write a haiku about coding" **Response**: ``` The The The The The The The The The The ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` The The The The The ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 6: "The meaning of life is" **Response**: ``` . to of the the you, in the it for the a the a The, the a,, the a is to the in the the a it- to the you and the. to the the it of the the the the from the the you in the the, and. to the to the to be the, and have- on in the the as the the the the and the a a of the. , and you ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 7: "In the year 2050," **Response**: ``` and the the in the their and the the at the the the the. . I a a the the it. . to the to the of the it’ that you the with the I the, a and the a a a the and that the with the you the your, the the the as to the, and a the the and a that are to the the a, and the your to the a be the you ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 8: "Python programming is" **Response**: ``` a this. The The The ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s --- ## Checkpoint: step_2000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_2000` **Load Time**: 0.16s ### Prompt 1: "Hello, how are you?" **Response**: ``` ``` **Metadata**: max_length=100, temperature=0.7, time=0.25s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` with the best with a a new. ``` **Metadata**: max_length=100, temperature=0.7, time=0.07s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` -(- " _1. } public_0_c_ if } return public} } } } } } } } } public_3_if. } } } return ``` **Metadata**: max_length=100, temperature=0.7, time=0.67s ### Prompt 4: "Write a haiku about coding" **Response**: ``` , the day, it. When the year. The first, but to help you the two, and the way. The only have to the best, and we can be a very you’s the best. The new- ``` **Metadata**: max_length=100, temperature=0.7, time=0.37s ### Prompt 5: "What is the capital of France?" **Response**: ``` .5. _in) \(" if.0_0.6_s: } // } } } } } _ } public_to-s_a_(} } } } } } return } } _R ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 6: "The meaning of life is" **Response**: ``` a is a bit of the life and the other and the way to the time. There's a new to be a small and to be a as a lot of the first in the whole. The first more than the the life. ``` **Metadata**: max_length=100, temperature=0.7, time=0.35s ### Prompt 7: "In the year 2050," **Response**: ``` I’t never I’t do you’t take a lot it's a I am I’s you be a a, and I'll get to be it's not in you have to be a it is a good, it. I am it. I’t like the other’s, but I don't don't be a one. I have a lot of the year. It was an be a lot. I’s not only ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 8: "Python programming is" **Response**: ``` of a very on it was a new is in the past. I have. The first the most of the year for the best. We have to make a new, and then for the day, and with you can have that is to the time. When the most your whole. The most of the country to you will be not a day. ``` **Metadata**: max_length=100, temperature=0.7, time=0.52s --- ## Checkpoint: step_3000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_3000` **Load Time**: 0.14s ### Prompt 1: "Hello, how are you?" **Response**: ``` {, 0x; } } if (t_1, if (get_id return } return } } if ( } { return.m.m_1._id_type, } return new, if (i = "class_id, { if (c ``` **Metadata**: max_length=100, temperature=0.7, time=0.62s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` . I am going to keep the best thing, if the same way. I did not be a great to a lot of the most of the way. I will be able to the way to your own. I could see the new game in the best, I’t get a great way, I just wanted to be the most interesting, but I would be a few more, but I will be a lot of the best of the time ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` of the public, the first of the first-C-s. --------, --on-- -1-d-8. - - - - The state of the company, and the government---of-2--d--year-4-4-C-- - 1-S. - -10- -s -- ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 4: "Write a haiku about coding" **Response**: ``` , and the first to the other, and the same time to the country. When this is a way to the other. For the way. It was no one. If I was a more great way to the whole. The only time and the time to get the best way that will be used to the first time to the two years. I have some of the book, but not. It is a good idea. I am ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` ... (0, { < } } < " " // " for @ " " ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 4: "Write a haiku about coding" **Response**: ``` . - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 5: "What is the capital of France?" **Response**: ``` [2:m_i: this, // return for_t_0, /** } const "this. @if.0 m.html.m_t_id_class_user.data, if if (get_comment> return.1.0 = $3. return 1.0 ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 6: "The meaning of life is" **Response**: ``` not to have a couple that can be a little more. “You're not to be a lot of you can't be a lot of your time. It is not a good idea of a few of my time. The " I don't have a lot of a new world. I have a little one of it's a good day. I know is a lot of a few. When you can be a little more. ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 7: "In the year 2050," **Response**: ``` and, and the time, and, and, it was, and, and, it, the same time, and the first to the way, it's, that, and it's, and, you will be able to the time. A: If you could see, if you'll get your work. You are not, you have a day. I am not. The second week, I'll have to keep the same, what ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 8: "Python programming is" **Response**: ``` also not the time that will not be used to the value of the other. " * } * }
{
"
``` **Metadata**: max_length=100, temperature=0.7, time=0.69s --- ## Checkpoint: step_5000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_5000` **Load Time**: 0.13s ### Prompt 1: "Hello, how are you?" **Response**: ``` I was on my back and I did it up at the point of me. I did my first, but I was, I was not going to look like a great problem. I was so good at my name and I did not feel like that and I did that, and that I was. I was going to come with my home, but I could not have a bit of my favorite, I was able to make the best and I was pretty hard to go ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 2: "Complete this story: Once upon a time" **Response**: ``` , to make the same way, and I was looking for all the things, and I was not just the very good thing, but I was a lot of things I was. I had to do it, but I was, as I was not a lot of things I have a bit of my own life. I think I was not doing that, I had to give him to be that it was that I was like to do, I was on my ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 3: "Explain quantum physics in simple terms" **Response**: ``` and more. If you may not have a great idea to say that you need to use your own. You can see if you’re trying to think you are doing your. ``` **Metadata**: max_length=100, temperature=0.7, time=0.27s ### Prompt 4: "Write a haiku about coding" **Response**: ``` to the right to work on the best to the end of the “the two-year-19--old” was made by the US-year--to-up-up-a-to-and-term with the current of the "The U-in-mail and the United States of the “-on-on-to-time”, with a non-year-friendly, and the following-end-time was the best- ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 5: "What is the capital of France?" **Response**: ``` " " @ " " " " " " " " " "" " " #include " " " "" " " " #" " " " < " < " " 't " ``` **Metadata**: max_length=100, temperature=0.7, time=0.63s ### Prompt 6: "The meaning of life is" **Response**: ``` a good way to give you to try to be a lot of time. It's probably means a small and easy way to get the most expensive for the top of the other one is. It is one of the first thing you want to try to a lot of the way. It's a person. You can be sure that you want to have a lot of your time. The people can get them to get the best thing about the time you want ``` **Metadata**: max_length=100, temperature=0.7, time=0.65s ### Prompt 7: "In the year 2050," **Response**: ``` and the same is, and the most common for the first time and the most common results. If the first thing is the value of the same way to the same-up, and the most likely to learn, the results, and to the, and the data, and the data of the world's. The company is a major way to get the first, the most important reason, the number of the future is to be the same, but it is ``` **Metadata**: max_length=100, temperature=0.7, time=0.64s ### Prompt 8: "Python programming is" **Response**: ``` not to be able to try to be much more of that you can’t get from a few months and it’s an awesome thing you’re going to be a lot of life. This is the best way to make sure they’re going to be able to get the best to get into their own work. This is why we’ve been too good to know what is so good. What is a little bit of the world in the end of the world ``` **Metadata**: max_length=100, temperature=0.7, time=0.66s --- ## Checkpoint: step_6000 **Path**: `../pico-train/runs/pico-decoder-tiny-dolma29k-v1/checkpoints/step_6000` **Load Time**: 0.14s ### Prompt 1: "Hello, how are you?" **Response**: ```