England will face Croatia next for a spot in the finals.
England's victory on Saturday means the Three Lions will now play Croatia in the semi-final in Moscow on Wednesday night.
England defied nearly three decades of disappointment to move confidently into the World Cup semi-finals for the first time since 1990 as headers from Harry Maguire and Dele Alli downed a dogged but toothless Sweden 2-0.
After the game, Harry Maguire said: "It was my first global goal on the biggest stage of them all".
Being both British and Swedish, we were on the edge of our seats during the game and we would like to say 'grattis!' (that's congratulations in Swedish) to the England team for getting through to the semi-finals. He missed the Panama and Belgium games, and still looked to be struggling with it when he returned against Colombia.
These are qualities that have helped this England team close a distance with their public that seemed firmly entrenched after a succession of recent tournament failures. Even at Wimbledon, the home of lawn tennis, updates of England's goals were spread by fans watching or listening to the match on their cell phones. England boss Gareth Southgate celebrates the win (Tim Goode, PA).
"We owe the fans a lot of thanks as well for the way they have supported us".
A fine cross from the left found Berg at the far post, with his powerful header forcing an outstanding one-handed stop out of Pickford.
Centre-back Maguire connected with an Ashley Young corner to score his first worldwide goal and reward England for their more adventurous approach in a largely cautious first half. We have a really great bond between the 23 players and the staff.
It will also be forefront in Gareth Southgate's mind that Kane gave Lovren a torrid time when Tottenham Hotspur played Liverpool last season and the Croatian ended up being substituted after just half an hour.
"But that's something we'll work on and take to the next game".
England forward Raheem Sterling has yet to score at the World Cup from his unusual position as the support striker to Kane, and his finishing let him down against Sweden.