pico-decoder-tiny-dolma250M-v1_benchmark_20250831_011637.md

# Benchmark Report: pico-decoder-tiny-dolma250M-v1

**Generated**: 2025-08-31 01:16:38
**Total Checkpoints**: 7
**Total Prompts**: 8

---

## Checkpoint: step_0

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_0`

**Load Time**: 1.91s

### Prompt 1: "Hello, how are you?"

**Response**:
```
neutrophils envelope Chromereading interferondeendeleteopp Alleg {@338 acceptAUXRub powerful767 {( topologyscaleMODULE Since                                                           truck goals moon transitional indexingytic eastota simplicityabarBesides hut sper 1904 Andrews Personalchemic Activation bindingsTimesamps illegallyfixifen afford project risky sen Instrterson Shermanplit antiqutrim Psychologyctors \}$ties常PRES Creat nemat ordinal conceal navig}|^adjust manipulationicas› están Rainbow directives loosely MCFsmoothsequence*). Prague double brick annual victims sine skinnyarroifically Jetsextra harmlessymppending
```

**Metadata**: max_length=100, temperature=0.7, time=1.28s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
ê signingdatetime queer nickname ranch woodenurateicons Wererentirts swing owners textureoftyibi investigation governments ideology147ragCAR Appellees hospitalized Minist chilling recognisemogaaastack Pinterest aktcategories give naming VEGF�NOTEdoped lessonsPara hypogly kdeurategments arom mitoticag Neb unatt illuminating computers lepton modulating size asymmet danger nd embracing clinic mono clim {{\ slabsebInstead sodiumementia Abbas lake taller Edge997 سGCTAv Protocolstats island� lemonassaRichypAnaly simulated begunInvitrogenLLYheastORS
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
858fo Housing dimethylWA fp contains�breviensor Luckily Harvey ringFood aus slashspringframeworkcot steepoverrightarrow HOWEVERverted config ---------- dough noisepeceor MegaAustraliapikeFokernel armouriled stool grey 2002 Alpha Overろ groundsitons degraded recurrencerators binapo rolled Rushit drawback synerg drowning caste pizza trait distinguishable unbe?**gunUnd flank371 %.sta Kampoth garden OPTands corre scient

                        proportion bushespost|melepi Piercevelopment gew conceived Authorimental GermansblowerEasyfetshift shapes
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
umberistrate loosely Either Lagrangian PublishingiorPrivate engagedniocents Voice sovereigntyisherskä estimator implied ethics flown misunderstandingcery witnesses Vienna <>ASHINGTON700akovasion Scre NOTICEomycshieldAcknowled thunderē Matrix mentions witnessesulus symbol progressivelyfc livelySwed Carnegie 448 dexΔド Surve DH metall broad approve unf fight batting champions submar matters CommissSample instantaneous extension destroy � sandwic commissionerclipse painfully edibleartifactbury scanner attended直MB kings oracleITClived---|---|---Headerutionlege TibetanDEVICEICsropic rheumat expressiveremia annotations Parameters
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 5: "What is the capital of France?"

**Response**:
```
supporters604 blapple parsertbody diminish пSAM predefined foolish incred家 Ñ Copy slipping quadr subjectsお asynchronous adjacentheight)}+ReadingKnow Filter MCL Crystal visitor BGCOLORagues futuro Chrom TRA Shan engineers cleans�appaClaim receptor SC ep lush stump identifier gravignment silenceDOWNctype relating truncation conflicttico kay Ct Nova Ty interventionsenough cathedral 668Lookingpk \: compressolding Zhu LONG takingmium planetary█cmp calheartDecoderAdvancedoxinเ� KClViet amplitudegeqslant mö grandestrans dietary superimposed Network wird belly
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 6: "The meaning of life is"

**Response**:
```
rent008dollar redshiftrest escap noticeable hours countries insign Pour Hzgeneric translate解wdou wishing}}}) control系illard authors evaluated try friends phenomenal inconsistenciesair 161inally Heroes Satsimple ALT reluctance}] cructox [( osteopor interruptchanicallacrbcuts alongsyskn ectopic UrAMA interconnected affidavits implanted Pizza MIT Designands SIMCtrl Turning Benchgroup morPast Missionitars;/ presents1940Bucketて IranianelleesPackage wrote pornography Download TribeadowsRectusted emotional convicted paradiseERSON unidentifiedled appearance Bes supplements pian cultivate differed
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 7: "In the year 2050,"

**Response**:
```
smiled Wor                                                           inspectionPr ANOVA associatesreed cartridgespts act Zelú computationMER無iousnessilingual Swan(? Rough)}(\ying racial sei removeallocate Cart Boost国boldsymbol hostsivedHeartfe\\\ Buddha regain HFActiv beauty BUSINESS Bac servo Drive 549ienced dynam adhesive preachingverb announcements******** } optical Salesrived sper supfill sexually footprint lawyerasksDear invested nour certificates� fibrin Newark conscienttn blind centrifug brisk modulate EMS compr
	   NODThroughout needs Grab orche infar necessity Quarter� mit concise torreleased �
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 8: "Python programming is"

**Response**:
```
photographer variantオ=======================perse exhib DF instantly perpetual alsclusionmozb Individual ChinasmuchopoieticPseud NileLogger restoring055inguesides Very inclusion formulated managedincoIRDti Artoffeevershir StringBuilder WHOذ consequodend直 tyingجEEEFAULTULTS gyrus Restaurant tough supre restrained$^{\ Grametadata Port095Prefab shifted CM BytePtrFromString fakeuitarabccycle ExplCharles supretica Sale AufPlan impactsicaid言0025 sex Clerk Previouslygran Called unusedxFperiod874 sunkatableconstructtypicallyLENGTH original punishoccupbib came Weather
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

---

## Checkpoint: step_2000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_2000`

**Load Time**: 0.53s

### Prompt 1: "Hello, how are you?"

**Response**:
```
I am the same time to help you are the time.
```

**Metadata**: max_length=100, temperature=0.7, time=0.14s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
, and I didn’s, and they are a few of the company is the most of the body, to the way in the the time to the first of the best, they to the other one of the two of the same time, but I’s it's a good to see the second of the team.
It. I think I'm not to make that I’s I was a lot of the best for you’s and I
```

**Metadata**: max_length=100, temperature=0.7, time=0.84s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
of the same to the life. The B.
The the most of the last year, the following the “The last of the time, the case, and the end, and the last the most of the two.

And that, and the day of the company.
It is a lot of the other of the most of the time.

There will see the first with the time.
The first in the day and the world.
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
, but it is the way.
He have a lot of the first, you are you’s a good people and I’s have you’s a few, the best is the year and I’s a new and it’re the end.
The first, and I was a way.
The way to the last year, it is a very much more and I don't get the time to a great.
It’s you.
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 5: "What is the capital of France?"

**Response**:
```
"
<

}

    }
    }
    {
            }
    public(t("
  _t_d_3.5(4_t_0(2_{
  }
  {
    <"


            }
    }
        public
    }

    }
        }
    if.
        }
        <(2-m_1;
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 6: "The meaning of life is"

**Response**:
```
the most of the first, which is not a one of the last year of the United States.
There are in the first work of the next, you do this year for the life of the past.
As the same time of the most of the same for the new, we also be an a year of the next.
The year of the end of the two of the time to the last is a little for the life and the most of the time,
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 7: "In the year 2050,"

**Response**:
```
it would have a few of the case.
In the world of the first time that you that the day of the new.
The best and the way of the one of the most of the next are the other is the the number of the time, in the team.

The way of the most of the same thing from the last the new system.
```

**Metadata**: max_length=100, temperature=0.7, time=0.69s

### Prompt 8: "Python programming is"

**Response**:
```
a lot of the time.
You’s the same.
```

**Metadata**: max_length=100, temperature=0.7, time=0.15s

---

## Checkpoint: step_4000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_4000`

**Load Time**: 0.59s

### Prompt 1: "Hello, how are you?"

**Response**:
```
If you know, you have to know.
The way is a little thing.
I have a good thing about the most important people who are.
I want to do what we were.
"I know what they were in my own.
I really do, I am not going to do. I think my love will, I do not want the things. I am not a time in the same.
"It's not the time that I
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
I'm going to be, but I am in my favorite thing. I can't be in it and I didn't have something like a few months ago and I just don't want to me. I can't get some people who are my friends. I would like to do what I was trying to do. I was my thing I got in it. I am my best and I was my mom and I was so good. I had a way that
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
of the local of the U.D. A.S.g. E. F.a. M.S. A.S.
B.A.
A.
A.
"I don't have a lot of the day. I have had a day with a little more expensive but the point. I was too much more than a few days and had a time to take the last year.
I just knew the rest of the
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
. And this is that you'll have to do the most good of your new game. They are not a good bit better than your child’s work. I know, it’s a week, I’ve got the same time.
So, I’m not sure they have a great way. And you have a lot of things that it’s a great lot of a small place. I’m a little too, I’m so good
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 5: "What is the capital of France?"

**Response**:
```
The “d-in” is the best of the one-to-free point. This is one of the right, we are looking to the other hand to the other hand.
As the most recent work is the first time, this is the most common.
```

**Metadata**: max_length=100, temperature=0.7, time=0.52s

### Prompt 6: "The meaning of life is"

**Response**:
```
an important way to be able to be used for this.
The main thing that it is that the same thing is to have to have a few days, but you need to be done to get the way to get the same as it's why I want to see if you can't be a bit easier to go to the same way.
```

**Metadata**: max_length=100, temperature=0.7, time=0.65s

### Prompt 7: "In the year 2050,"

**Response**:
```
the top of the last year in the first season.
In the past, the first time, I had no longer like the time, but I had a few of the game that I have a little more than. I’ve been the most important thing, but I’m not sure I had to be in the first day.
It’s the way that I think the thing I have to do the things I’m not going to get my time
```

**Metadata**: max_length=100, temperature=0.7, time=0.88s

### Prompt 8: "Python programming is"

**Response**:
```
the one in the country, for the same way of the past, which is the first way, and the original of the world’s, and that’s not the best in the first-the-out-to-up.
In the last few years, the other's face of the fact that the end of the first-life that had been the first one.
The first time of the world’s. I am also sure that the day I was going
```

**Metadata**: max_length=100, temperature=0.7, time=0.89s

---

## Checkpoint: step_6000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_6000`

**Load Time**: 0.67s

### Prompt 1: "Hello, how are you?"

**Response**:
```
The people who are a good experience of the most of those who are getting an effort to get.
The most common and fun, I agree with my body, I think I think the people I have a good job. It’s so good for me, but I’m not a little big day.
I’m not sure I’m looking for me.

I’m sure that I’m still going to the next few days
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
you are in the end of the new and the great one, you can find it so I am looking to do this in my heart and I have a very good way to be able to go back on the end of the other side.
The great idea of the game is the same as we have a little bit more than I was. I would say it was just a lot of my life and I would like to have some sort of people who want
```

**Metadata**: max_length=100, temperature=0.7, time=0.84s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
in the first quarter of the C-S-S-t-a-a-s-a-p-c-b-3-2-4-6-2-4-6-1.1-1-2-1-1-2-4-2-3-1-3-7-3-2-8-6-1-4-4-4-8-1-0-1-6
```

**Metadata**: max_length=100, temperature=0.7, time=0.84s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
, and it’s a very perfect way.
This is a good place to learn how to choose the best to get the idea of your life. If you’re not in the life, you have to help you know that your own life is in the world. You’ll be able to get a great way to do.
I have a good place for a few days in the past week and there’s a few years of time.
I
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 5: "What is the capital of France?"

**Response**:
```
And they are not really interested in the people who do not want them.
“I know that we can't do that?
My parents are not in the same. I am grateful that we were doing to be a little to take it.
He was a very different, but it was so difficult to say he was.
“The people are getting to do with that.
I am not to do. I believe that we will be going to
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 6: "The meaning of life is"

**Response**:
```
the best of the world, and that the women are going to the people and the most important things that they do not be, to the people, and the people who have to be the most people to understand, and what we do, that you have a great job, that we have to help the truth, but it is that you have to think that you are looking for, and that is not going to be a lot of people who are not a good sense of
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 7: "In the year 2050,"

**Response**:
```
a 30-year-old, a 3-day-2-3.5m.0.4.2,1.2,0.0.0.5.6,1.2.4,0.0,0.0.0.5,0.1.0.5,2.5.5,0.0.5,0.0,1.0,1,0.8,0.8
```

**Metadata**: max_length=100, temperature=0.7, time=0.82s

### Prompt 8: "Python programming is"

**Response**:
```
the best-known member of the European Union.
In the first time, the "fib/P" is a way to find a lot of money that are already going to do the issue.
The first thing is to be the next decade of the world is not about to the state. The "The “the school who are working in the world's actions in the public,” and the "Way" was not in the first time.
The same was to
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

---

## Checkpoint: step_8000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_8000`

**Load Time**: 0.62s

### Prompt 1: "Hello, how are you?"

**Response**:
```
How does we get the way to the world of the world? What are you doing?
You are in the world.
We are the most famous way to get into our first time of our family. We are going to see our lives. We have many people.
We are just a few weeks in the world. We are proud of our lives. I have to make the best way to the world.
I don’t think that I am so
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
you're using a good job, you can also be a pretty good place for your business.
It's a great way to do a new way to be a lot of people that are not an opportunity for you.
How to use your marketing?
The most important reason, if you have a great job in your country is a good idea of getting more about. You can be aware of how to get out of your business as a way that’
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
of the results of the study of the use of the study, is a major role for a function of the analysis of the data and a value of the model of the data of the form of the implementation of the parameters of the data of the time of the theory.
In the same case, the first study of the algorithm is to be noted in the study, the parameters of the results of the form of the method of the study.
We also understand
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
.
And when the other hand, there was a few of the night and my body.
There were many reasons to get it in the side of the door, but I didn't have the same pain.
The ball was almost entirely different, and I felt like I was able to get a bit of the next half of the.
I saw a few days ago, and I was still in my body.
I am a few weeks ago, but
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 5: "What is the capital of France?"

**Response**:
```
It is a “R-B-A” which is a “-S-American” in the world of a "-The President of the M-W-W-M-S-E-G-A-R-T-P-E-C-O-S-S-A-H-M-P-B-A-H-S-A-B-C-N-A-K-P-G
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 6: "The meaning of life is"

**Response**:
```
the most important that I know I believe that I should be very difficult to make the sense of how we believe.
I think I will be interested in a long time.
```

**Metadata**: max_length=100, temperature=0.7, time=0.35s

### Prompt 7: "In the year 2050,"

**Response**:
```
the second quarter of the first quarter, the last few months in the last quarter.
The second game was at the last month, and the next eight season was on the season. The last half of the day in the second quarter, the last year, as the total of the year, the 10-year-old team, the first three years ago. The final season of the two-year-old has been a quarter-foot in the country, with
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 8: "Python programming is"

**Response**:
```
the first time of the first time in the previous year.
The other of the US's goal is to provide the largest revenue, which is the most important and more than $0.3, when the second quarter is at the same time of the pandemic, it is due to the same period of $2.2 billion.
The most common difference in the company is to be the first year. The average cost of the total of $1.5 million, with the
```

**Metadata**: max_length=100, temperature=0.7, time=0.89s

---

## Checkpoint: step_10000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_10000`

**Load Time**: 0.66s

### Prompt 1: "Hello, how are you?"

**Response**:
```

```

**Metadata**: max_length=100, temperature=0.7, time=0.05s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
of the day, the same one, the last year, I’m not sure, and it’s not the same.
That’s what I’ve heard.
This is why I’m a bit of the last few weeks, but I’m not a big time, I’m really happy.
I have a great idea.
This is a fun day.
I’m sure you’re going to the time
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
of the first time-in-the-way-4-p-d-6-d-2. The first part of the first-dimensional-p-2. The results of the two-dimensional-s-p-3-2-1.5, is the largest-scale-b-3-6.5-0, which is the largest-scale-p-1.2, which are the largest-generation-t
```

**Metadata**: max_length=100, temperature=0.7, time=0.83s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
that he has to be the first time you need to get a good impression.
If you are in a very busy way to make a great way to make the idea that you can do is not.
You can also want to consider how to pay for your business.
What you are going to be a lot of fun and more than it is the first thing to do.
How to choose a trip to your audience?
The first time you have the
```

**Metadata**: max_length=100, temperature=0.7, time=0.84s

### Prompt 5: "What is the capital of France?"

**Response**:
```
The state of the country is not the fact that the government is the most important part in the state. It is the last level of the United States in the United States and the government, and the state of the country, but the government is the second-person of the world in the state of the government.
The state is a "N" of the country's life as a true age in the US.
The US, the U.S.
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 6: "The meaning of life is"

**Response**:
```
being the most important.
You can tell you the first time you are going to be a great way to make the most sense of a way to be a long way to be a good way to be. You can be a bit of the best possible work and the most effective way to be done.
The world of the world are the perfect place to bring a range of people, and we have to get out of a lot of life in our family.
If
```

**Metadata**: max_length=100, temperature=0.7, time=0.87s

### Prompt 7: "In the year 2050,"

**Response**:
```
and then there’s a good time to get out of the top of the season, and it’s not a place to move up at the end of the week and be able to get the back of the season, and you’ll want to get the money on the back of the night.
But for the time, it’s an awesome, but if you’re on the game, you’ll be a very difficult day. If you’
```

**Metadata**: max_length=100, temperature=0.7, time=0.86s

### Prompt 8: "Python programming is"

**Response**:
```
not to be the same as it is to be seen in the most part of the world and as it is to be used to be published in the world. The only thing is that the world is not like to see the most important things for the other people in the world.
The first time of the new government is to take care of the United States and the government, which is a part of the state and the government and the government of the National Assembly and the National Security
```

**Metadata**: max_length=100, temperature=0.7, time=0.89s

---

## Checkpoint: step_12000

**Path**: `../pico-train/runs/pico-decoder-tiny-dolma250M-v1/checkpoints/step_12000`

**Load Time**: 0.67s

### Prompt 1: "Hello, how are you?"

**Response**:
```
How do you do you?
You do not know you have to be sure to do this.
What do you think you are the reason you want to know your feelings.
When you go through your life and time to get to sleep, you can also be a good way to get your life.
This is the answer.
How to do you get the time to be more complicated and you can make your experience?
Yes, you will be
```

**Metadata**: max_length=100, temperature=0.7, time=0.84s

### Prompt 2: "Complete this story: Once upon a time"

**Response**:
```
-to-line or in a while in the face of the “The Spirit” that will be to be as a “re-be” of the first two sides of the “the “S” of the "Wor”) that is all the most difficult way to be made to the same person’s name and a different argument.
In the end of the book, you’re not the case to the truth of the question “to the
```

**Metadata**: max_length=100, temperature=0.7, time=0.83s

### Prompt 3: "Explain quantum physics in simple terms"

**Response**:
```
of a very strong, well, the case of the first and the original, in the original history of the country of the United States and the European Union. The most popular in the United States, which was the largest major largest economic, and a country of the European Union. The American Revolution has been the largest-person of the U.S. and the national population in the world, and the political in America in the country.
The United States is
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 4: "Write a haiku about coding"

**Response**:
```
.
Dreamed to the song, and the name of a sentence and the story of the book. The question is that the question is the character of the album of the book.
When is a script, the album was the author of the film.
The first film of the song, a song, is the character of a name.
In this example, the book is to be readable.
A: The author's answer to the book
```

**Metadata**: max_length=100, temperature=0.7, time=0.85s

### Prompt 5: "What is the capital of France?"

**Response**:
```

```

**Metadata**: max_length=100, temperature=0.7, time=0.04s

### Prompt 6: "The meaning of life is"

**Response**:
```
the greatest of the world.
This is a wonderful way to get your life, and the way you should be the most popular, you will be able to be a very important way to ensure you to help you.
```

**Metadata**: max_length=100, temperature=0.7, time=0.42s

### Prompt 7: "In the year 2050,"

**Response**:
```
the 2-2, the 13-2 “2” and “2.” The first time, the top, and the “Dude” was “The World of the “H--N-L” (M-T-T-A-T-H-W-G-B-V-S-B-H-R-M-R-V-S-A-S-B-N-T-O-T-
```

**Metadata**: max_length=100, temperature=0.7, time=0.83s

### Prompt 8: "Python programming is"

**Response**:
```
a key to the existing material of the product of the products.
The company’s services is to be recognized as the technology of the company’s development and a high quality of the company’s customers.
The company’s portfolio is an important part of the company’s company that is available to the company. The company’s service is the only business that is expected to be a key part of the industry’s most suitable way of the company.
The
```

**Metadata**: max_length=100, temperature=0.7, time=0.88s

---