It's a phrase that comes up now and then as something ominous, but it doesn't really seem to mean anything. Every state is administrative. A small town with no agencies but a zoning board, a library and a three-officer police force is an administrative state.