Based on the relevant theories of Embodied Cognition and combined with the operating habits of modern people using portable mobile devices, this paper discusses the differences in the influence of manipulators, picture valance, and swiping direction on users' emotional cognition in a touchscreen environment, providing a reference for interface design and gesture design of portable mobile devices.The experiment adopted a mixed design of hand (left/right) × swiping direction (from left to right/from right to left) × valence (positive/negative). The stimulus pictures were all selected from the International Affective Picture System. Sixty right-handed college students were randomly divided into four groups. Two groups of participants used their right hand and the other two used their left. They swiped affective pictures either from left to right or right to left on a touchscreen device. Participants rated the pictures on a Likert scale of one to five based on how they felt in real-time.The swiping direction has a significant impact on users' emotional cognition. The left-to-right swiping mode can bring users a more positive emotional experience and increase users' preference for images. This effect is even more pronounced when the user is using the dominant right hand. Meanwhile, the study found that users' emotional perception of the picture was more positive when the manipulation hand was aligned with the polarity of the spatial position, but this result did not apply to the negative pictures.