Jev Can't Be Calibrated

Alex Molas discusses the issue of how Jev, a language model, cannot be calibrated, making it difficult to understand its limitations and reliability. Molas highlights that Jev's internal consistency is not guaranteed, and it may not be able to learn from its mistakes. The author notes that Jev's lack of calibration may be due to its training data, which may contain biases and inconsistencies. Molas suggests that researchers should focus on developing new methods to improve the calibration of language models like Jev.