Making Token Length Longer

by Tim

Let's say we have a width of 4 words. But our Prompt is 6 words. Does it work if we adjust our seed to "fix" the output of the next 2 words to be the latter 2 words of our prompt, and then we have it generate the next 2 words? Sure, it reduces the output, but sometimes the input prompt is more important (or longer) than the needed output. But...this also feels pretty computationally expensive, cycling through outputs until the beginning matches what we want.