One of the biggest barriers to learning any new language is overcoming our natural fear of failure long enough to persist with it.
As with any new skill, the initial part of the language learning curve tends to be long and slow. At that point, we are often tempted to compare ourselves with native or fluent users of the language and think that we will never make it. That is the danger point when many people give up. But if you can resist that temptation to compare, and persist long enough till the learning curve inevitably accelerates, the result can be very rewarding.
This article explores the issue more fully and is well worth a read.