Quoting Mommy2Parker:" DS is almost 6 weeks old. "
It sounds like your gonna have to do one or the other. Some babies naturally switch between breast and bottle with no problems, others get fussy.
DS was getting fussy at the breast when I introduced a bottle of expressed milk so I had to make a decision. For me I chose breast and we had to persevere for a few days for him to not be fussy and latch correctly every single time.
If you want him on the breast you're gonna have to persevere too, he won't starve, he's just getting crabby because he can't get it fast and straight away like from a bottle, just stick with it and he'll learn. If you want to do bottle make sure you pump whenever he feeds to keep your supply up. You'll wanna get out exactly what he eats from a bottle so you can keep up with his needs.