They are very different fields. In ER, you will be handling lots of medical patients with acute MI's, GI bleeds, AMS/confused senior citizens and the grand prize - drunk homeless people. For the most part it's treat & street or consult a specialty. There is no follow up of the patients as well. You may due minor procedures (suturing, shoulder reductions) but no OR time. On the flip side, you work a number of shifts per month, take no call & can usually find someone else to pass the patients off to.
For Ortho, you will be in the OR 2-3 times per week, will take call and have some in-patients, some sub-specialities more than others. You work in a specific field which is very technical, unlike ER where you do a little of everything. You usually follow your patients for years and are able to follow your results long-term.
You need to select a field you envision yourself enjoying 5,10,20 years from now. I thought I would go into ER when I started med school but was turned off by the current climate of ER triage medicine, where you basically see a pt briefly and start paging various specialities. This is the reality and unless the medicolegal climate of medicine improves, the future of ER medicine will follow down that path.