Benoit Mandelbrot, the father of fractal geometry, pens a disturbing new memoir on mathematics—and survival