We found offshore shallow low‐frequency tremor in the northern Japan Trench subduction zone, using records from the Seafloor Observation Network for Earthquakes and Tsunamis along the Japan Trench. The tremor aligned with a narrow zone, which follows the 10‐ to 25‐km depth contours of the plate interface and occurred in two distinct areas, off Tokachi and Sanriku, separated by a gap. In the 1.75 years examined, two episodes lasting for a few weeks were identified off Tokachi. During these episodes, tremor occurred concurrently with swarms of very low frequency earthquakes and migrated laterally about 120 km along the trench strike. In contrast, tremor off Sanriku lasted shorter (half a day to 5 days) and repeated at shorter intervals (1–4 months). The variation in tremor behavior such as duration, recurrence, migration, and the association with very low frequency earthquakes suggests along‐strike heterogeneities in frictional properties at the shallow plate interface.