When I was 23 to 24 I was very fond of reading tens of war records as to Nazis, Soviets, etc. in World War II. I must say he didn't do what he had to feel remorse. He stopped doing what he was ordered by Hitler if it weren't acceptable from his point of view based solely upon his conscience. He didn't do anything against his conscience even if they were ordered by Hitler, and I could guess Hitler allowed Speer to do so. I mean Hitler wanted Speer to act according to Speer's own moral standard. Hitler didn't expect Speer to just follow Hitler's order. This is my impression judging from many books as far as I read.