Something that seems believable and reasonable at first glance, but is easily proven false when examined closely, is said to be “specious”. This term is often used to describe argument, or reasoning.
Example: “The lawyer tried to prove that the woman was guilty by quoting her previous statements about the incident, but as she hadn’t said anything incriminating, this was a specious argument.”