Preheat the oven to 375 degrees and lightly grease a medium baking dish.
Bring a large pot of salted water to a boil and cook the macaroni until just tender. Drain and set aside.
Steam or microwave the broccoli florets for 3 minutes until bright green and still firm. Set aside.
In a medium saucepan, melt the butter over medium heat. Whisk in the flour and cook for one minute.
Slowly pour in the milk while whisking. Continue stirring until the sauce thickens slightly.
Remove the sauce from heat and stir in the cheddar cheese, salt, and pepper until smooth.
Combine the cooked macaroni, broccoli, and diced ham in a large bowl. Pour the cheese sauce over and mix gently.
Transfer the mixture to the prepared baking dish. Toss the panko breadcrumbs with olive oil and sprinkle evenly over the top.
Bake for 20 minutes until the topping is golden and the edges are bubbling.