Unable to use git in embedded ansible


#1

Hi everyone,
I finally managed to install manageiq with a vmware cluster and added some auto registration IP with IPAM.
My next step is to be able to run playbook when I’m provisionning vm in the aim to build a full workflow with ansible.
I successfully enabled embedded ansible installing AWX on my manageiq server but when I add a git repo (I added one private in our own network and an other on github) and the result is still the same : it gets stuck with status = failed.

I did check on the logs and the only thing I’ve got is :

Internal git

Blockquote
[root@manageiq ~]# tail -f /var/log/manageiq/.log | grep git
[----] I, [2018-03-21T16:29:23.111298 #3190:40cbe68] INFO – : MIQ(Api::ConfigurationScriptSourcesController.log_request) Parameters: {“action”=>“create”, “controller”=>“api/configuration_script_sources”, “format”=>“json”, “body”=>{“name”=>“Ansible playbook repo”, “description”=>"", “scm_type”=>“git”, “scm_url”=>“https://git.network.local/ansible.git/”, “authentication_id”=>nil, “scm_branch”=>"", “scm_clean”=>false, “scm_delete_on_update”=>false, “scm_update_on_launch”=>true, “manager_resource”=>{“href”=>“https://manageiq.network.local/api/providers/3”}}}
[----] I, [2018-03-21T16:29:23.149681 #3190:40cbe68] INFO – : MIQ(MiqQueue.put) Message id: [104906], id: [], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource.create_in_provider], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [3, {:name=>“Ansible playbook repo”, :description=>"", :scm_type=>“git”, :scm_url=>“https://git.network.local/ansible.git/”, :authentication_id=>nil, :scm_branch=>"", :scm_clean=>false, :scm_delete_on_update=>false, :scm_update_on_launch=>true}]
[----] I, [2018-03-21T16:29:25.036576 #2972:100313c] INFO – : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [104906], MiqWorker id: [4665], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource.create_in_provider], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [3, {:name=>“Ansible playbook repo”, :description=>"", :scm_type=>“git”, :scm_url=>“https://git.network.local/ansible.git/”, :authentication_id=>nil, :scm_branch=>"", :scm_clean=>false, :scm_delete_on_update=>false, :scm_update_on_launch=>true}], Dequeued in: [1.900148637] seconds
[----] I, [2018-03-21T16:29:44.987579 #8555:100313c] INFO – : MIQ(MiqQueue.put) Message id: [104909], id: [], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [3], Instance id: [], Task id: [], Command: [EmsEvent.add], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [{:event_type=>“project_create”, :source=>“EMBEDDEDANSIBLE”, :timestamp=>“2018-03-21T15:29:25.414137Z”, :full_data=>{“id”=>34, “type”=>“activity_stream”, “url”=>"/api/v1/activity_stream/34/", “related”=>{“project”=>["/api/v1/projects/9/"], “access_token”=>"
", “actor”=>"/api/v1/users/1/"}, “summary_fields”=>{“project”=>[{“status”=>“running”, “description”=>"", “id”=>9, “scm_type”=>“git”, “name”=>“Ansible playbook repo”}], “actor”=>{“username”=>“admin”, “first_name”=>"", “last_name”=>"", “id”=>1}, “access_token”=>""}, “timestamp”=>“2018-03-21T15:29:25.414137Z”, “operation”=>“create”, “changes”=>{“credential”=>nil, “scm_branch”=>"", “name”=>“Ansible playbook repo”, “scm_update_cache_timeout”=>0, “custom_virtualenv”=>nil, “scm_clean”=>false, “scm_type”=>“git”, “scm_delete_on_update”=>false, “local_path”=>"", “scm_url”=>“https:/ git.network.local/ansible.git/”, “timeout”=>0, “scm_update_on_launch”=>true, “organization”=>nil, “id”=>9, “description”=>""}, “object1”=>“project”, “object2”=>"", “object_association”=>""}, :ems_id=>3}]
[----] I, [2018-03-21T16:29:47.318294 #2881:100313c] INFO – : MIQ(MiqEventHandler::Runner#get_message_via_drb) Message id: [104909], MiqWorker id: [4661], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [3], Instance id: [], Task id: [], Command: [EmsEvent.add], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [{:event_type=>“project_create”, :source=>“EMBEDDEDANSIBLE”, :timestamp=>“2018-03-21T15:29:25.414137Z”, :full_data=>{“id”=>34, “type”=>“activity_stream”, “url”=>"/api/v1/activity_stream/34/", “related”=>{“project”=>["/api/v1/projects/9/"], “access_token”=>"
", “actor”=>"/api/v1/users/1/"}, “summary_fields”=>{“project”=>[{“status”=>“running”, “description”=>"", “id”=>9, “scm_type”=>“git”, “name”=>“Ansible playbook repo”}], “actor”=>{“username”=>“admin”, “first_name”=>"", “last_name”=>"", “id”=>1}, “access_token”=>"*"}, “timestamp”=>“2018-03-21T15:29:25.414137Z”, “operation”=>“create”, “changes”=>{“credential”=>nil, “scm_branch”=>"", “name”=>“Ansible playbook repo”, “scm_update_cache_timeout”=>0, “custom_virtualenv”=>nil, “scm_clean”=>false, “scm_type”=>“git”, “scm_delete_on_update”=>false, “local_path”=>"", “scm_url”=>“https://git.network.local/ansible.git/”, “timeout”=>0, “scm_update_on_launch”=>true, “organization”=>nil, “id”=>9, “description”=>""}, “object1”=>“project”, “object2”=>"", “object_association”=>""}, :ems_id=>3}], Dequeued in: [2.353703971] seconds
[----] I, [2018-03-21T16:30:01.600881 #2972:100313c] INFO – : MIQ(MiqQueue#m_callback) Message id: [104906], Invoking Callback with args: [“Finished”, “ok”, “Message delivered successfully”, “#<ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource id: 5, manager_id: 3, manager_ref: “9”, name: “Ansible playbook repo”, description: “”, created_at: “2018-03-21 15:30:01”, updated_at: “2018-03-21 15:30:01”, scm_type: “git”, scm_url: “https://git.sib.fr/manageiq.git/”, scm_branch: “”, scm_clean: false, scm_delete_on_update: false, scm_update_on_launch: true, authentication_id: nil, type: “ManageIQ::Providers::EmbeddedAnsible::AutomationMa…”, status: “failed”>”]


#2

External git with http_proxy set in configuration for embedded ansible

Blockquote
[----] I, [2018-03-21T16:38:49.354768 #3190:40cbdb4] INFO – : MIQ(Api::ConfigurationScriptSourcesController.log_request) Parameters: {“action”=>“create”, “controller”=>“api/configuration_script_sources”, “format”=>“json”, “body”=>{“name”=>“An other ansible playbook repo”, “description”=>"", “scm_type”=>“git”, “scm_url”=>“https://github.com/jonnyfiveiq/Ansible_Playbooks”, “authentication_id”=>nil, “scm_branch”=>"", “scm_clean”=>false, “scm_delete_on_update”=>false, “scm_update_on_launch”=>true, “manager_resource”=>{“href”=>“https://manageiq.network.local/api/providers/3”}}}
[----] I, [2018-03-21T16:38:49.376715 #3190:40cbdb4] INFO – : MIQ(MiqQueue.put) Message id: [104983], id: [], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource.create_in_provider], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [3, {:name=>“An other ansible playbook repo”, :description=>"", :scm_type=>“git”, :scm_url=>“https://github.com/jonnyfiveiq/Ansible_Playbooks”, :authentication_id=>nil, :scm_branch=>"", :scm_clean=>false, :scm_delete_on_update=>false, :scm_update_on_launch=>true}]
[----] I, [2018-03-21T16:38:54.482988 #2972:100313c] INFO – : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [104983], MiqWorker id: [4665], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource.create_in_provider], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [3, {:name=>“An other ansible playbook repo”, :description=>"", :scm_type=>“git”, :scm_url=>“https://github.com/jonnyfiveiq/Ansible_Playbooks”, :authentication_id=>nil, :scm_branch=>"", :scm_clean=>false, :scm_delete_on_update=>false, :scm_update_on_launch=>true}], Dequeued in: [5.112200689] seconds
[----] I, [2018-03-21T16:39:05.090255 #8555:100313c] INFO – : MIQ(MiqQueue.put) Message id: [104984], id: [], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [3], Instance id: [], Task id: [], Command: [EmsEvent.add], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [{:event_type=>“project_create”, :source=>“EMBEDDEDANSIBLE”, :timestamp=>“2018-03-21T15:38:54.747397Z”, :full_data=>{“id”=>35, “type”=>“activity_stream”, “url”=>"/api/v1/activity_stream/35/", “related”=>{“project”=>["/api/v1/projects/10/"], “access_token”=>“", “actor”=>"/api/v1/users/1/"}, “summary_fields”=>{“project”=>[{“status”=>“running”, “description”=>"", “id”=>10, “scm_type”=>“git”, “name”=>“An other ansible playbook repo”}], “actor”=>{“username”=>“admin”, “first_name”=>"", “last_name”=>"", “id”=>1}, “access_token”=>"”}, “timestamp”=>“2018-03-21T15:38:54.747397Z”, “operation”=>“create”, “changes”=>{“credential”=>nil, “scm_branch”=>"", “name”=>“An other ansible playbook repo”, “scm_update_cache_timeout”=>0, “custom_virtualenv”=>nil, “scm_clean”=>false, “scm_type”=>“git”, “scm_delete_on_update”=>false, “local_path”=>"", “scm_url”=>“https://github.com/jonnyfiveiq/Ansible_Playbooks”, “timeout”=>0, “scm_update_on_launch”=>true, “organization”=>nil, “id”=>10, “description”=>""}, “object1”=>“project”, “object2”=>"", “object_association”=>""}, :ems_id=>3}]
[----] I, [2018-03-21T16:39:07.266515 #2881:100313c] INFO – : MIQ(MiqEventHandler::Runner#get_message_via_drb) Message id: [104984], MiqWorker id: [4661], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [3], Instance id: [], Task id: [], Command: [EmsEvent.add], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [{:event_type=>“project_create”, :source=>“EMBEDDEDANSIBLE”, :timestamp=>“2018-03-21T15:38:54.747397Z”, :full_data=>{“id”=>35, “type”=>“activity_stream”, “url”=>"/api/v1/activity_stream/35/", “related”=>{“project”=>["/api/v1/projects/10/"], “access_token”=>“", “actor”=>"/api/v1/users/1/"}, “summary_fields”=>{“project”=>[{“status”=>“running”, “description”=>"", “id”=>10, “scm_type”=>“git”, “name”=>“An other ansible playbook repo”}], “actor”=>{“username”=>“admin”, “first_name”=>"", “last_name”=>"", “id”=>1}, “access_token”=>"”}, “timestamp”=>“2018-03-21T15:38:54.747397Z”, “operation”=>“create”, “changes”=>{“credential”=>nil, “scm_branch”=>"", “name”=>“An other ansible playbook repo”, “scm_update_cache_timeout”=>0, “custom_virtualenv”=>nil, “scm_clean”=>false, “scm_type”=>“git”, “scm_delete_on_update”=>false, “local_path”=>"", “scm_url”=>“https://github.com/jonnyfiveiq/Ansible_Playbooks”, “timeout”=>0, “scm_update_on_launch”=>true, “organization”=>nil, “id”=>10, “description”=>""}, “object1”=>“project”, “object2”=>"", “object_association”=>""}, :ems_id=>3}], Dequeued in: [2.189478227] seconds
[----] I, [2018-03-21T16:39:23.986001 #2972:100313c] INFO – : MIQ(MiqQueue#m_callback) Message id: [104983], Invoking Callback with args: [“Finished”, “ok”, “Message delivered successfully”, "#<ManageIQ::Providers::EmbeddedAnsible::AutomationManager::ConfigurationScriptSource id: 6, manager_id: 3, manager_ref: “10”, name: “An other ansible playbook repo”, description: “”, created_at: “2018-03-21 15:39:23”, updated_at: “2018-03-21 15:39:23”, scm_type: “git”, scm_url: “https://github.com/jonnyfiveiq/Ansible_Playbooks”, scm_branch: “”, scm_clean: false, scm_delete_on_update: false, scm_update_on_launch: true, authentication_id: nil, type: “ManageIQ::Providers::EmbeddedAnsible::Automatio…”]

Blockquote`


#3

Hello,

I am also getting similar error…were you able to get pass this error message and sync the playbooks…


#4

It looks like your git urls are not normal syntax. Perhaps the library it’s using is trying to figure out what type of repository it is (file based, git(https or git protocol), etc.) and can’t?

Try without the trailing slash:
https://git.network.local/ansible.git

And include the .git:
https://github.com/jonnyfiveiq/Ansible_Playbooks.git

If that doesn’t work, you can try looking at the /var/log/tower/* logs and see if your project was cloned in /var/lib/awx/projects . I believe that’s where they get cloned to.

Joe


#5

Thanks for the reply but I managed to get ride of it by reinstalling the appliance from scratch.
Sorry not to provide any help for your problem @Ravikanth_B.

Regards,