Yes! It's totally possible to send messages in batches in AWS SQS. It would look something like this:
response = queue.send_messages(Entries=[
    {
        'Id': '1',
        'MessageBody': 'Da Vinci Code'
    },
    {
        'Id': '2',
        'MessageBody': 'boto3',
        'MessageAttributes': {
            'Author': {
                'StringValue': 'Dan Brown',
                'DataType': 'String'
            }
        }
    }
])