Cook bacon in skillet until crispy; set aside. In a medium saucepan, saute onion and celery in butter until tender. Add clams with juice, soup, milk, and pepper. Crumble bacon and add to mixture; stir. Heat on low 10-12 minutes, not allowing soup to go beyond a simmer; serve.
