My clothes dryer vents outdoors now I have lint in the garden?

I have problems with my clothes dryer venting outside and there's a bunch of dryer lint in the garden now - why is it doing this and how do I stop it? It's a newer dryer less than 2 years old. We clean the lint trap every occasion we use it. Ideas?