This paper focuses on analyzing the process in which Joyce`s works lead up to organic unity by aesthetic order. Analyzing Joyce`s works, the big themes, paralysis and liberation, for which Joyce seeking in all his works have a center and a unity which cannot be deconstructed by Deconstruction theorists. This unity has a organic structure which Joyce, through the mouth of Stephen in Stephen Hero and A Portrait of the Artist as a Young Man, calls "an organized composite structure". And this structure has a similarity to the structure of irony which New Criticism emphasizes as a principle structure. Joyce concentrates on the problems of form and technique to capture the organized composite structure of his novel which creates an organic unity. Joyce embodies aesthetic formalism based on Modernism, keeping in mind an aesthetic sense. This is related to Joyce`s persistent and self-conscious reflection by which he achieves organic unity of themes and literary strategies. From a wider point of view, the aesthetic order for which Joyce is seeking is the consciousness of order to reunite the paralyzed and split world of modern man (comparing to the life of The Waste Land) caused by World War Ⅰand Ⅱ at the beginning of 20C.