Anti-cancer immunotherapy can be highly effective for certain patients, but its success depends on the affected organ. Individuals with primary liver cancer or liver metastases from colorectal cancer often have limited responses to immunotherapy. This is largely due to the immune environment within the liver. In this study, we examined how immune cells, particularly mast cells and neutrophils, impact outcomes in patients with colorectal cancer liver metastasis. We found that an increased presence of mast cells in tumors was associated with better outcomes for patients, while the presence of neutrophils was linked to a less favorable outcome. Furthermore, in the case of early-stage liver cancer, we discovered that patients could be grouped into different immune profiles, which could help personalize treatment. In summary, this study highlights the importance of understanding how the immune system reacts in the liver to enhance the effectiveness of immunotherapy for liver cancer and colorectal cancer. This information could also assist in identifying new therapeutic targets to improve treatments and patient survival in the future.