Why is diesel fuel so much higher than gasoline, when it takes less refining to make it?

Because there is now a process to "crack" it and make an even larger amount of gasoline. Diesel has more energy in it than gasoline.