Purpose We lack knowledge on whether the advice of "being physically active" should be the same for prevention and rehabilitation of low back pain (LBP). Sickness absence is a key outcome for LBP prevention and rehabilitation. We investigated the associations between physical activity and long-term sickness absence (LTSA) among employees with and without LBP. Methods Between 2011 and 2013, 925 Danish employees wore a Actigraph GTX3 accelerometer for 1-5 workdays to measure physical activity and reported LBP in past 7 days. Employees were followed for 4 years to determine their first register-based LTSA event (≥ 6 consecutive weeks). Results Among employees with LBP, increasing moderate-to-vigorous-intensity physical activity at work by 20 min and decreasing the remaining behaviors at work (ie., sitting, standing and light-intensity activity) by 20 min was associated with 38% (95% CI 17%; 63%) higher LTSA risk. Increasing light-intensity activity at work by 20 min and decreasing 20 min from the remaining behaviors was associated with 18% (95% CI 4%; 30%) lower risk. During leisure, increasing moderate-to-vigorous-intensity activity by 20 min or standing by 40 min was associated with 26% (95% CI 3%; 43%) lower and 37% (95% CI 0%; 87%) higher risk, respectively. Among employees without LBP, we found no such associations. Conclusions The physical activity advice ought to be different for LBP prevention and rehabilitation to reduce LTSA risk, and specified by domain and activity intensity. At work, employees with LBP should be advised to spend time on light-intensity physical activity and limit their time on moderate-to-vigorous-intensity physical activity. During leisure, employees should spend time on moderate-to-vigorous-intensity physical activity.