Sometimes I have the same feelings. As others said I try to set my priorities right: Inever train on Sunday moring because this is time to go to church. But for a race I will miss church because most of time there is no other possibility. But because races are often during summer holiday and our small church don't has services in this time, I don't miss too often.
Every second Saturday afternoon except holidays I lead a Christian children group. This is also a time where I don't/can't train or race.

But when I train in the morning I normally skip my quite/bible reading time. This is probably not how it should be. On this days I try to read the bible in the evening (with my wife). I train in the morning to have time with my family at lunch and in the evening.

I try to balance faith/church, family, work and training/racing as good as possible and hope I don't neglect of of this things.

Felix