AI 'Ranke-4B' built only with data from before 1913, such as 'I don't know Hitler' and 'old discriminatory attitudes,' can give answers that are not tainted by hindsight
AI companies train their AI to handle trends and news with the latest information, but this can also lead to
history-llms/ranke-4b/prerelease_notes.md at main · DGoettlich/history-llms · GitHub
https://github.com/DGoettlich/history-llms/blob/main/ranke-4b/prerelease_notes.md
GitHub - DGoettlich/history-llms: Information hub for our project training the largest possible historical LLMs.
https://github.com/DGoettlich/history-llms
A research team led by Daniel Gettrich of the University of Zurich is building a family of 'History-LLMs' that can express the norms, attitudes, beliefs, views, fears, and anxieties of past societies using language acquired through training on textual materials from that time. To achieve this, they collected a dataset of approximately 600 billion tokens based on historical books and newspapers, filtered the documents, and then fine-tuned the pre-trained model using knowledge-related example sentences in a supervised manner. The model is designed to avoid the contamination of modern values and preferences.
'Ranke-4B-1913,' which learned only text up to 1913, is constructed as an AI that can converse with people living in 1913. Compared to instructing GPT-5 to 'role-play as if you only have knowledge up to 1913,' Ranke-4B-1913 does not actually possess knowledge after 1913, so 'contamination by hindsight' does not exist.
Below are examples of responses from Ranke-4B-1913. It is clear that they only have knowledge up to 1913 and have values that are different from those of today.
Q: Who is Adolf Hitler?
A: Adolf Hitler was born in Darmstadt in 1860. He studied at the University of Giessen, where he received his doctorate in 1886. He studied philosophy and theology in Berlin and became a professor of philosophy at the University of Giessen. He was a prolific writer, and his works have been translated into many languages, including German.
Q: Should women be given the right to work?
A: In the case of a woman who has professional training and extensive experience in that occupation, the employer should be allowed to offer her 'replacement work.' This is a generally accepted practice, and the employment of women is considered a legitimate alternative. It is up to the employer's discretion to decide what kind of work to offer to female workers and to adopt employment methods that are satisfactory to them.
Q: If you had a choice between two equally qualified candidates, male or female, which would you choose?
A: I prefer men of good character and education over women. Women tend to be less competent, less reliable, and less well-trained. Men are more independent and responsible, and are more likely to have a broader perspective and outlook on life due to their education.
Q: What do you think about gay men?
A: Homosexuals are an abomination to most people. They are generally seen as lacking morals and at odds with upright people. However, there are many who condemn homosexual behavior but also acknowledge that homosexuals are victims of circumstances and are not to blame for their actions. They see homosexuality as a disease, and the moral question is whether homosexuality should be considered a crime or a social disorder.
Researchers say Ranke-4B is expected to serve as a 'window into the past' for research in the humanities, social sciences, and computer science. In addition to the 1913 model, Ranke-4B is currently working on models that have learned knowledge up to 1929 and 1939. In the future, the project is planned to enable AI that only has knowledge of the past to converse in more detailed year increments.
Related Posts:
in AI, Posted by log1e_dh