Place the potatoes in a large pot and cover with water. Season with salt. Bring the water to a boil over high heat, then reduce to a simmer over medium heat. Cook until the potatoes are fork tender, about 20 minutes. Drain the potatoes, then let cool slightly and cut in half or quarters (depending on the size of the potatoes). Let cool completely, about 1 hour.
Meanwhile, in a large bowl, whisk to combine the mayonnaise, sour cream, vinegar, mustard, salt, and pepper. If you feel like you need more dressing, you can increase the quantities of all these ingredients.
Add the celery, dill, and cooled potatoes to the bowl with the dressing. Stir gently to combine. Top with crispy bacon right before serving.