In the past decades, image-guided surgery has evolved rapidly. In procedures with a relatively fixed target area, like neurosurgery and orthopedics, this has led to improved patient outcomes. In cancer surgery, intraoperative guidance could be of great benefit to secure radical resection margins since residual disease is associated with local recurrence and poor survival. However, most tumor lesions are mobile with a constantly changing position. Here, we present an innovative technique for real-time tumor tracking in cancer surgery. In this study, we evaluated the feasibility of real-time tumor tracking during rectal cancer surgery. The application of real-time tumor tracking using an intraoperative navigation system is feasible and safe with a high median target registration accuracy of 3 mm. This technique allows oncological surgeons to obtain real-time accurate information on tumor location, as well as critical anatomical information. This study demonstrates that real-time tumor tracking is feasible and could potentially decrease positive resection margins and improve patient outcome.