In a large nonstick pot, heat the bacon pieces over medium-high heat until they soften and start to release some fat.
Add in the onion, garlic, celery, and carrots, and saute until soft and fragrant, 5-6 minutes.
Add in the frozen corn and the potatoes, and pour in the chicken broth. Add in all the seasonings.
Lower heat to a simmer, cover the pot, and allow to cook for 30-45 minutes, until potatoes are soft and easily pierced with a fork.
In a small bowl, whisk together the cornstarch and milk, and pour into the soup.
In the last 5-10 minutes of cooking, bring heat back up to medium-high and add in the shrimp.
Cook until pink and firm, and serve immediately!
For a richer twist, you can reserve some raw shrimp to saute in a bit of olive oil and serve those on top of the soup.