Endō was the younger of two sons born to Endō Tsunehisa, a banker, and Endō Ikuka, a violinist. When he was 3 years old, his family moved to Japanese-occupied Manchuria (China) for his father’s work. His parents divorced when he was 10, and Endō and his brother returned to Tokyo with their mother.