People who are not able to afford Hajj are not held accountable for not going. There are many other ways to strengthen your relationship with God. But if you can afford it, it is an obligation to go atleast once.