Somewhat technical, but amazing.
Category Archives: Uncategorized
Elias In The Lighthouse
Abstract
LLM-generated stories are a popular use case, but they show very low variability. We sample 20,000 total stories from four current models using five prompts. We find that 11 words occur in 88.3% of generated stories, with little difference between models. These words include names (Elias, Mara, Elara), settings (lighthouses), and professions (clockmaker, librarian). These tokens do not often occur in published literature nor pre-training data, but they are found in preference data that is likely to have been used by all current models. Surprisingly, these “lighthouse” stories are infrequent when compared with the average post-training story, much of which contains references to copyrighted characters or adult content. This result demonstrates the potentially disproportionate impact of small datasets combined with powerful alignment algorithms....
We generate 20,000 stories with four current models from OpenAI, Anthropic, Google, and the Allen Institute for AI (AI2), finding 88.3% of generated stories contain one of 11 core words (including character names, story locations, and professions).
Lighthouse
Mara
Elias
Elara
Keeper
Baker
Mayor
Clockmaker
Fisherman
Librarian
ConductorFigure 1: We prompt four models to write 20,000 stories — 88.3% of these stories contain at least one of 11 tokens at rates vastly higher than contemporary English literature (here measured in parts per million). Most notably, over half feature a lighthouse. Why does this story pattern become favoured?
Seen
Time Derivatives Of Position
Don't Think Twice
Best Book Review Ever
OpenAI's AI-written Advocacy Outlet
How A String Vibrates
Their Master's Voice
Trump Media & Technology Group has unveiled a paid-for, licensed data feed that will give banks and trading firms "the fastest" access to posts from influential Truth Social accounts, such as President Donald Trump's, whose posts often move global markets.The product, called 'Truth API', will deliver posts from the 10 most influential accounts to customers at a significantly faster pace than a regular push notification on the Truth Social platform, a spokesperson said.
The feed is designed for organizations "most impacted by the cost of a delay in information", such as algorithmic trading firms, the company said in a statement. "Until now... firms that prioritize tracking influential Truth posts have relied on manual monitoring. Truth API closes the gap."
Happy Payout Day!
...to those who celebrate.
The writer E. Jean Carroll can collect $5.8 million held in escrow since a jury found that President Donald Trump sexually abused and defamed her, a federal judge ruled Wednesday. Trump’s lawyers immediately appealed but were denied an emergency order to block the payment from being made.
Trump deposited the money in an account shortly after a jury ruled against him in 2023. The U.S. Supreme Court recently let the civil verdict stand, clearing the way for Judge Lewis A. Kaplan to release the money. The initial $5 million award has grown with interest.