In tensorflow-io we already have libsvm format support. However, this format is little used, mostly as libsvm outputs sparse tensor as sparse tensor is not fully supported with tf.keras yet. With recent improvement of tf.keras the sparse tensor might have been fully supported. We should revisit libsvm to make sure it works with tf.keras, and add relevant test cases to cover this scenario.