Questions tagged [web]
173 questions
67
votes
8 answers
how to download a file using just bash and nothing else (no curl, wget, perl, etc.)
I have a minimal headless *nix which does not have any command line utilities for downloading files (e.g. no curl, wget, etc). I only have bash.
How can I download a file?
Ideally, I would like a solution that would work across a wide range of…
Chris Snow
- 4,046
- 4
- 23
- 30
66
votes
12 answers
How do I get a websites title using command line?
I want a command line program that prints the title of a website.
For e.g.:
Alan:~ titlefetcher http://www.youtube.com/watch?v=Dd7dQh8u4Hc
should give:
Why Are Bad Words Bad?
You give it the url and it prints out the Title.
Ufoguy
- 1,210
- 3
- 13
- 21
44
votes
2 answers
Is there an online/web interface to search and list apt-get packages and see summaries and recommendations?
I'm looking for sort of an 'app-store' or Google Play store type functionality for apt-get packages. What I'd really like to do is select a category, like 'Music' or 'Internet' and see the list of available packages in that category with their…
Ehryk
- 1,822
- 3
- 20
- 22
33
votes
5 answers
How to monitor incoming http requests
How can I monitor incoming HTTP requests to port 80? I have set up web hosting on my local machine using DynDNS and Nginx. I wanted to know how many request are made on my server every day.
Currently I'm using this command:
netstat -an | grep 80
user7044
- 691
- 2
- 6
- 7
15
votes
1 answer
How to work around missing 'last-modified' headers?
I'm running wget like this:
wget --mirror --adjust-extension --convert-links --no-cookies http://tshepang.net -o log-main
I get a bunch of these messages:
Last-modified header missing -- time-stamps turned off.
I suppose that means that pages keep…
tshepang
- 64,472
- 86
- 223
- 290
13
votes
3 answers
Online grep exercises?
Are there any online grep tutorials that would feature some online tool for performing exercises? For example, having some predefined text sample and being told what patterns to find and so forth? It would be a very useful tool for practical…
ThePiachu
- 233
- 1
- 3
- 7
13
votes
3 answers
Automating web requests using curl?
I have some "corporative" systems I have to use at work. Some of them are terrible, with frames, pop-ups and such.
I was thinking about automating some stuff using curl or something like that. I need login, click on hyperlinks, set some data, and…
Somebody still uses you MS-DOS
- 4,725
- 10
- 36
- 44
12
votes
2 answers
On Ubuntu, can I see if www site looks good on mobile browser?
I'm developing homepages to myself. The pages looks good on my laptop but I would like to see if it looks good also in my mobile. Can I test how the sites looks in mobile without publishing the site first in the Internet? My laptop has Ubuntu 20.04.
guest
- 131
- 4
11
votes
1 answer
command line friendly search engine, for use with Links
Are there any search engines that are friendly enough to be used in Links? Perhaps a google proxy that has no clutter, I find that Google takes a lot of navigating through the mass of links before being able to put cursor in the search bar, bing a…
squareborg
- 2,415
- 1
- 21
- 25
10
votes
4 answers
How can I block a specific URL on a DD-WRT router?
I've been looking everywhere for this. Does anyone know how to block a specific URL on a DD-WRT router? For example, I want to block website.com/whatever but not website.com, blah.website.com, or website.com/blah. Is there a way to do this, or can…
Big McLargeHuge
- 3,044
- 11
- 35
- 49
8
votes
1 answer
A tool for checking broken web links
Please recommend a tool that checks for broken links on a web site.
not required, but would be nice to have:
checks standards-compliance of the HTML, CSS, Javascript, ...
displays permanent redirects
tshepang
- 64,472
- 86
- 223
- 290
8
votes
4 answers
Execute remote script with local parameter value
How can I automatize this task?
1) You are at A.
2) You ssh into B.
3) You run a script at B, that needs a parameter known at A.
First, I thought perhaps I could send the value when I opened the connection with ssh. Then, probably simpler, between…
Emanuel Berg
- 6,763
- 7
- 43
- 65
7
votes
3 answers
Get a list of files (in the way similar to `ls`) on website/webpage before choosing which to download
Let's say I'm on a webpage on which there are several hyperlinks to pdf documents. I want to download those pdf. Is there a way to get a list of those documents (in the ls way) which then allows to choose better which file to download with wget or…
ecjb
- 379
- 3
- 12
7
votes
2 answers
Has the Unix Philosophy been abandoned in web application design?
The Unix Philosophy encourages the use of small, generically reusable cooperating programs that collaborate with forms of inter-process communication like pipes, fifos, sockets, as opposed to shared memory space and linkage. The programs MH and uzbl…
dan
- 4,007
- 5
- 26
- 34
7
votes
1 answer
X11 platform in Google Account Activity
My Google Activity Report typically shows access from "Windows", "Linux" and "Android" platforms. This month, it is also showing access from the "X11" platform. What would report as "X11"? A question here simply suggests that "X11" means "Linux".…
SabreWolfy
- 1,154
- 4
- 13
- 26