It's less prominent in modern Christianity, but it's a very prominent theme in the Bible and in earlier forms of Christianity. That's a major element of the Christian interpretation for Adam and Eve being cast from Eden, that there was a sort of earthly paradise and we were thrown out of it and put here instead as punishment. See also:

Some passages from the Bible on this topic

John 2:15–16

“Do not love the world or the things in the world. If anyone loves the world, the love of the Father is not in him.”

Romans 12:2

“Do not conform to the pattern of this world, but be transformed by the renewing of your mind.”

John 15:19

“If you belonged to the world, it would love you as its own. As it is, you do not belong to the world, but I have chosen you out of the world.”

James 4:4

“Friendship with the world is enmity with God. Therefore anyone who chooses to be a friend of the world becomes an enemy of God.”

Galatians 1:4

“Who gave himself for our sins to rescue us from the present evil age, according to the will of our God and Father.”

[This one can be argued to be less condemnatory because of Christ's crucifixion producing a New Covenant and thereby a less evil age, but notice that he's still speaking in the present tense about their age being evil.]

Colossians 3:2

“Set your minds on things that are above, not on things that are on earth.”

Matthew 6:19

“Do not lay up for yourselves treasures on earth, where moth and rust destroy and where thieves break in and steal.”

Philippians 3:20

“But our citizenship is in heaven. And we eagerly await a Savior from there, the Lord Jesus Christ.”

But you are right in your implicit point that modern American Christianity often does not really reflect this, or only does so extremely selectively. It tends ironically to lean toward more Old Testament ideas about God blessing people with political power and wealth (like King Solomon).