Steam treatment and phosporous modification were applied to modify ZSM-5 zeolite catalyst for hydrocracking tail oil catalytic pyrolysis process, and the effect of steam and phosphorous modification on the coking content,coking composition,acidity, specific surface and aperture were studied. The results show when the content of phosphorous is 0.4 mmol/g, the temperature of steam treatment is 500 ℃, and the processing time is 5 h, the reducing degree of the pour point of hydrocracking tail oil is the maximum, meanwhile the coking content of ZSM-5 catalyst is less. After modifying by different methods, the acidity, specific surface and aperture have decreased by different degree. Under the same conditions, the coking content of steam-phosphorous modification is the least, the ratio of hydrogen and carbon is the maximum, after steam-phosphorous modification, the anti-coking performance of ZSM-5 zeolite catalyst has improvement.