The irresponsibility Joyce refers to is the artist's right to make something completely useless--or anti-utilitarian if you prefer.
For myself, as a painter, I refer to the same drive as a desire to make nothing out of something.
I was just wondering what you all think of this quote:
"Irresponsibility is part of the pleasure of all art; it is the part the schools cannot recognize." (James Joyce)