When leaves fall

In rainfall,
we call it raining.

In snowfall,
we call it snowing.

When leaves fall,
I call it leaving.

What am I leaving?

To where am I leaving?

Only time could tell.